Postproc: ValueError: Incorrect size for fixed length header; given 0 words but should be 256

Unified Model
, ,
1

Hi CMS Helpdesk
I have put a hold on the pptransfer in my 2 suites that I just put a warm start on today on PUMATest, pending jdma completion of tape archiving of old data on JASMIN and hence more space availability on JASMIN.

But I do have one postproc process that doesn’t seem to work, for u-cl527, cycle 19921201T0000Z.
I keep on getting the message below; any ideas?
Patrick

~pmcguire/cylc-run/u-cl527/log/job/19921201T0000Z/postproc/05/job.err:
Traceback (most recent call last):
  File "/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/main_pp.py", line 118, in <module>
    main()
  File "/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/main_pp.py", line 111, in main
    run_postproc()
  File "/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/main_pp.py", line 82, in run_postproc
    getattr(model, meth)()
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/timer.py", line 115, in wrapper
    out = function(*args, **kw)
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/atmos.py", line 519, in do_transform
    for fname in self.diags_to_process(finalcycle):
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/timer.py", line 115, in wrapper
    out = function(*args, **kw)
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/atmos.py", line 332, in diags_to_process
    elif validation.verify_header(
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/timer.py", line 115, in wrapper
    out = function(*args, **kw)
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/validation.py", line 178, in verify_header
    headers, empty_file = mule_headers(fname)
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/timer.py", line 115, in wrapper
    out = function(*args, **kw)
  File "/mnt/lustre/a2fs-work2/work/n02/n02/pmcguire/cylc-run/u-cl527/share/fcm_make_pptransfer/build/bin/validation.py", line 283, in mule_headers
    umfile = mule.UMFile.from_file(filename, remove_empty_lookups=True)
  File "/work/y07/shared/umshared/lib/python3.8/mule/__init__.py", line 1254, in from_file
    new_umf._read_file(file_or_filepath)
  File "/work/y07/shared/umshared/lib/python3.8/mule/__init__.py", line 1432, in _read_file
    FixedLengthHeader.from_file(source))
  File "/work/y07/shared/umshared/lib/python3.8/mule/__init__.py", line 555, in from_file
    return super(FixedLengthHeader, cls).from_file(source, cls._NUM_WORDS)
  File "/work/y07/shared/umshared/lib/python3.8/mule/__init__.py", line 393, in from_file
    return cls(values)
  File "/work/y07/shared/umshared/lib/python3.8/mule/__init__.py", line 527, in __init__
    raise ValueError(_msg)
ValueError: Incorrect size for fixed length header; given 0 words but should be 256.
[FAIL] main_pp.py atmos <<'__STDIN__'
[FAIL]
2

Patrick

There are several files of length zero in /home/n02/n02/pmcguire/cylc-run/u-cl527/share/data/History_Data - just a guess, but they may be the cause of the validation problem?

Grenville

3

Thanks, Grenville.

I deleted those files of zero length, and now postproc works fine.

I am waiting to check if I have non-zero-length copies of those files on JASMIN already. But I need to wait to see this, until my JDMA lock-from-read-access expires.
Patrick

4

Hi Grenville:
My JDMA lock-from-read-access on JASMIN expired, so I could check to see if I have non-zero-length copies of those files that I deleted empty copies of in my ARCHER2 History_Data directory for u-cl527.
I do have those files just fine on JASMIN.

Thanks,
Patrick