Hi Ros,
Thank you that has solved the postproc_cice issue.
However, pptransfer failed with
[WARN] [SUBPROCESS]: Command: globus-url-copy -vb -cd -r -cc 4 -verify-checksum -sync -cred /work/n02/n02/jweber/cred.jasmin /work/n02/n02/jweber/archive/u-cu408/20270701T0000Z/ gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20270701T0000Z/
[SUBPROCESS]: Error = 1:
error: Unable to list destination directory for sync: gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20270701T0000Z/
globus_ftp_client: the server responded with an error
500 500-Command failed. : an authentication operation failed
500-globus_gsi_callback_module: Could not verify credential
500-globus_gsi_callback_module: Error with signing policy
500-globus_gsi_callback_module: Error in OLD GAA code: The subject of the certificate “/DC=uk/DC=ac/DC=jasmin/O=STFC RAL/CN=JASMIN” does not match the signing policies defined in /home/users/jmw240/.globus/certificates/7ed47087.signing_policy
500 End.
[WARN] Transfer command failed: globus-url-copy -vb -cd -r -cc 4 -verify-checksum -sync -cred /work/n02/n02/jweber/cred.jasmin /work/n02/n02/jweber/archive/u-cu408/20270701T0000Z/ gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20270701T0000Z/
[ERROR] transfer.py: Unknown Error - Return Code=1
I can see that some data has been transferred to Jasmin and wondered if this could be a checksum issue. Your suite had checksum set to false whereas it was true for me. I ran u-cu408 for a further 3 months with checksum now false in postproc/rose-app.conf but this time postproc_nemo failed again with the error:
"Detected 1 oom-kill event(s) in StepId=3133450.batch. Some of your processes may have been killed by the cgroup out-of-memory handler.”
Does this require a change to the suite.rc or archer2.rc file?
When I set postproc_nemo to succeeded, pptransfer then failed with:
[WARN] [SUBPROCESS]: Command: globus-url-copy -vb -cd -r -cc 4 -verify-checksum -sync -cred /work/n02/n02/jweber/cred.jasmin /work/n02/n02/jweber/archive/u-cu408/20280401T0000Z/ gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20280401T0000Z/
[SUBPROCESS]: Error = 1:
error: globus_ftp_client: the server responded with an error
500 500-Command failed. : callback failed.
500-globus_gsi_callback_module: Could not verify credential
500-globus_gsi_callback_module: Error with signing policy
500-globus_gsi_callback_module: Error in OLD GAA code: The subject of the certificate “/DC=uk/DC=ac/DC=jasmin/O=STFC RAL/CN=JASMIN” does not match the signing policies defined in /home/users/jmw240/.globus/certificates/7ed47087.signing_policy
500 End.
Source: file:///work/n02/n02/jweber/archive/u-cu408/20280401T0000Z/
Dest: gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20280401T0000Z/
cu408a.pa2028jun.pp
Source: file:///work/n02/n02/jweber/archive/u-cu408/20280401T0000Z/
Dest: gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20280401T0000Z/
cu408a.pi20280101.pp
Source: file:///work/n02/n02/jweber/archive/u-cu408/20280401T0000Z/
Dest: gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20280401T0000Z/
cu408a.ps2028djf.pp
Source: file:///work/n02/n02/jweber/archive/u-cu408/20280401T0000Z/
Dest: gsiftp://gridftp1.jasmin.ac.uk/gws/nopw/j04/sheffield/jweber/mass_extracts/from_archer2/u-cu408/20280401T0000Z/
cu408a.pj20260701.pp
Bit confused by this. Might be two separate issues?
James