Hi, My JDMA tasks for two suites have been failing with the error: TypeError: ‘int’ object is not iterable [FAIL] jdma.py # return-code=1 I recently upgraded both suites to CYLC8, u-dr800 has completed successful JDMA tasks after the upgrade, while u-dr928 is on its first cycle. I don’t have an…

Hi all, Just bumping this: does anyone know if JDMA is working as it should, and if other suites are completing JDMA tasks successfully? Is this likely to be a CYLC8 upgrade issue, despite the tasks previously working after the upgrade? Thanks, Andrea

Hi All, Just an update, I have found the issue and my jdma tasks are now running. This issue was that I had changed [namelist:jasmin_arch] copy_streams=‘’‘p5’‘’ copy_target=‘’'/gws/nopw/j04/stabilisation/‘’’ to copy_streams=‘’‘5’‘’ as I still hadn’t found the right setting for this parameter…

Hi Andrea, Really sorry; this slipped through my net. The copy_streams functionality doesn’t control what streams are transferred from ARCHER2 to JASMIN. It is a mechanism to leave some streams on JASMIN disk rather than put them all to ET and then have to immediately extract a subset off of tape.…

Hi Ros, No problem, thanks for the explanation! Is there a way to define which streams are copied to JASMIN? At the moment it copies them all, which fills up my GWS very fast and I then need to periodically delete the streams I don’t need. It’s not a huge problem, but if there is a mechanism to do …

Hi Andrea, You’ll need to configure postproc so that it only process/archives the streams that you want. E.g. see postproc → Atmosphere panel. Switch process_all_streams to false and specify the atmos streams you do want to keep/archive. Or configure the model so it doesn’t even produce the strea…

Hi Ros, Thanks for your reply. My config is already using the JASMIN transfer cache, and I do want to keep all streams on tape, but I was hoping to copy only a specific stream to disk for immediate use (rather than bringing it back from tape). It sounds like it’s not possible to do that though (i.e…

Hi Andrea, Sorry - I feel we’ve just gone full circle. :rofl: That is exactly the what the copy_streams is to be used for. All data is transferred from ARCHER2 to JASMIN xfer cache and then before JDMA runs it copies a subset of those streams to GWS. Let me just look at the code; I can’t remembe…

Hi Andrea, It’s not you… it my dodgey code! :zany_face: I obviously didn’t test just a numerical stream. :roll_eyes: I’ll raise a ticket to remind myself to fix this in the next set of postproc changes I make. For now a quick fix is to specify ‘x5’, ‘5x’ or similar to force python to interpret i…

Thanks Ros! Just out of curiosity, why would ‘5x’ or ‘x5’ be interpreted differently than ‘p5’? I’d used p5 which was recognised as a string (i.e. jdma task didn’t crash) but it copied all streams to disk which wasn’t what I was looking for. Will ‘5x’ only copy stream 5? Thanks for investigating! …

JDMA failing

Unified Model

andreadittus 20 August 2025 10:52 9

Oh good to confirm - thanks!

I’ve raised a previous ticket which Grenville answered ( Postproc - copy_streams ), but somehow following these instructions hasn’t worked for me

Thanks!
Andrea

Topic		Replies	Views
JDMA error Unified Model ARCHER2	3	105	23 April 2025
Postproc - copy_streams Unified Model ARCHER2	1	73	28 May 2025
Re-running UKESM suites archiving issue Unified Model JASMIN , ARCHER2	1	62	6 February 2026
Transfer data to JASMIN Unified Model ARCHER2 , PPTransfer	23	328	13 November 2024
Vn13.3 AMIP suite on Archer2 Uncategorized Monsoon2 , ARCHER2	54	654	2 December 2024

JDMA failing

Related topics