Hi,
My suite id is u-db903, I get this error when running the suite. This suite is vn13.0 global model, I’ve run this for 2 days (with 1 day cycling time), the model ran for 1 day but crashed when executing the second day. I have 2 issues.
-
atmos_main executed for the first day, but I can’t seem to find the output files anywhere, share/data/History_data wasn’t even created.
-
atmos_main crashed for the second day with the following error (is it possible to increase my quota)
BUFFOUT: Write Failed: Disk quota exceeded
FLUSH_UNIT_BUFFER: Error Flushing Buffered Data
FLUSH_UNIT_BUFFER: Status is 1
FLUSH_UNIT_BUFFER: Length Requested was 4194304
FLUSH_UNIT_BUFFER: Length written was 8192
???
???!!!???!!!???!!!???!!!???!!! ERROR ???!!!???!!!???!!!???!!!???!!!
? Error code: 1
? Error from routine: portio2a:flush_unit_buffer
? Error message: Failed in output_buffer()
? Error from processor: 0
? Error number: 609
???
[0] exceptions: An non-exception application exit occured.
[0] exceptions: whilst in a serial region
[0] exceptions: Task had pid=105595 on host nid002510
[0] exceptions: Program is “/work/n02/n02/anran/cylc-run/u-db903/share/fcm_make_um/build-atmos/bin/um-atmos.exe”
Warning in umPrintMgr: umPrintExceptionHandler : Handler Invoked
srun: error: nid002510: task 0: Exited with exit code 255
srun: launch/slurm: _step_signal: Terminating StepId=5023151.0
slurmstepd: error: *** STEP 5023151.0 ON nid002510 CANCELLED AT 2023-12-06T02:19:35 ***
srun: error: nid002511: tasks 64-127: Terminated
srun: error: nid002512: tasks 128-191: Terminated
srun: error: nid002510: tasks 1-63: Terminated
srun: Force Terminated StepId=5023151.0
[FAIL] um-atmos <<‘STDIN’
[FAIL]
[FAIL] ‘STDIN’ # return-code=143
2023-12-06T02:19:35Z CRITICAL - failed/EXIT
Do let me know, Thanks in advance
Cheers,
Ananth