UKESM1.1 output accumulating in History_Data and exceeding ARCHER2 quota

Dear NCAS team,

I am running the UKESM1.1 vn13.9 suite u-ec043 copied from the official PI control suite u-dr681.

The suite uses monthly cycles and successfully transfers processed output to JASMIN using Globus. However, large amounts of data remain in share/data/History_Data after PostProc and PPTransfer succeed.

After two completed monthly cycles:

  • History_Data reached 56 GiB
  • NEMOhist alone reached 18 GiB
  • The JASMIN transfers succeeded, but only transferred 398 MiB for January and 2.4 GiB for February
  • During the third cycle, my 100 GiB ARCHER2 quota was exceeded while the atmosphere model was writing the next restart dump

The error was:

BUFFOUT: C I/O Error
FLUSH_UNIT_BUFFER: Failed in output_buffer()

The failed workflow is:

u-ec043/run1

I have committed the current suite configuration to MOSRS at Revision: 368348.

Could you please advise why files are not being removed from History_Data after successful post-processing and transfer?

The suite usespostproc_2.4_archer2_jasmin_rewrite, while the PostProc metadata is postproc_2.5. Could you also confirm whether this is the correct combination for u-dr681?

Finally, is a 100 GiB quota sufficient for this UKESM configuration, or could my quota be increased?

Kind regards,
Lucky