Corrupted ARCHER-JASMIN workflow

Unified Model
,
1

Hello,

I’m having problems with my ARCHER-JASMIN workflow. The data is being transferred to my JASMIN group workspace (GWP), which I think is working okay. However, the processed data on ARCHER is in my GWP in the archive folder and, after the data is transferred to JASMIN, it’s not being cleared. My ARCHER GWP then gets filled up, my runs stop, and transfer corrupted data over to JASMIN. Is there a way to make the archived data in ARCHER clear/delete itself once it’s successfully been transferred to JASMIN?

Many thanks,
Megan

2

Hi Megan,

What’s the suite id please?

Regards
Ros

3

Hi Ros,

This is happening for all my ARCHER2 runs, but the one I’m running right now is u-dk520.

Many thanks,
Megan

4

Hi Megan,

To set up automatic deletion of data from ARCHER2.

  1. First hold the suite and make sure the postproc & pptransfer tasks from the last cycle have both finished. Then
    in postproc → post postprocessing → archer archiving change archive_root_path to $ROSE_DATAC.

  2. In app/housekeeping/rose-app.conf add:

prune{share/cycle}=-P6M
  1. Reload the suite with rose suite-run --reload. Data will now be archived on ARCHER2 to the directory ~/cylc-run/<suite_id>/share/cycle and automatically deleted.

Regards,
Ros.

5

Hi Ros,

Thank you very much for this. I’ve added it in and set the model running again.

Cheers,
Megan

6

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.