# MPICH/ OASIS error in coupled run **URL:** \ **Category:** Uncategorized\ **Tags:** ARCHER2\ **Created:** [5 January 2026 11:25 UTC](https://cms-helpdesk.ncas.ac.uk/t/mpich-oasis-error-in-coupled-run/1948 "2026-01-05T11:25:23Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![James\_Weber](https://avatars.discourse-cdn.com/v4/letter/j/e495f1/32.png) [@James\_Weber](https://cms-helpdesk.ncas.ac.uk/u/James_Weber)\ **Post date:** [5 January 2026 11:25 UTC](https://cms-helpdesk.ncas.ac.uk/t/mpich-oasis-error-in-coupled-run/1948/1 "2026-01-05T11:25:23Z")
Hi CMS, A coupled run on Archer2, u-dv795, keeps failing well into a cycle with the job.err showing: MPICH ERROR [Rank 608] [job id 12054896.0] [Wed Dec 31 21:36:36 2025] [nid001363] - Abort(1) (rank 608 in comm 288): application called MPI\_Abort(comm=0xC4000002, 1) - process 608 srun: error: nid001363: tasks 1,33,76,93,96: Aborted srun: launch/slurm: \_step\_signal: Terminating StepId=12054896.0+0 srun: launch/slurm: \_step\_signal: Terminating StepId=12054896.0+2 srun: launch/slurm: \_step\_signal: Terminating StepId=12054896.0+1 slurmstepd: error: \*\*\* STEP 12054896.0+2 ON nid001380 CANCELLED AT 2025-12-31T21:36:36 \*\*\* slurmstepd: error: \*\*\* STEP 12054896.0+0 ON nid001260 CANCELLED AT 2025-12-31T21:36:36 \*\*\* slurmstepd: error: \*\*\* STEP 12054896.0+1 ON nid001363 CANCELLED AT 2025-12-31T21:36:36 \*\*\* Retriggering just yields the same error. The debug.root.02 shows: (oasis\_init\_comp) OPEN debug file for root pe, unit : 1025 (oasis\_mem\_init) Initset conversion flag is T (oasis\_mem\_init) 8 MB memory alloc in MB is 8.00 (oasis\_mem\_init) 8 MB memory dealloc in MB is 0.00 (oasis\_mem\_init) Memory block size conversion in bytes is 3775.25 (oasis\_mem\_print) memory use (MB) = 818.1926 74.3546 (oasis\_init\_comp) (oasis\_mem\_print) memory use (MB) = 989.2313 171.0567 (oasis\_enddef):start (oasis\_mem\_print) memory use (MB) = 990.0450 178.4914 (oasis\_enddef):part\_setup (oasis\_mem\_print) memory use (MB) = 990.0450 178.7291 (oasis\_enddef):var\_setup (oasis\_mem\_print) memory use (MB) = 990.0450 178.7291 (oasis\_enddef):write2files (oasis\_coupler\_setup) smatread\_method = ceg (oasis\_mem\_print) memory use (MB) = 1019.8668 207.7300 (oasis\_enddef):coupler\_setup (oasis\_mem\_print) memory use (MB) = 1019.8668 207.9352 (oasis\_enddef):advance\_init (oasis\_mem\_print) memory use (MB) = 1019.8668 207.9352 (oasis\_enddef):end (oasis\_abort) ABORT: compid = 0 (oasis\_abort) ABORT: called by = mppstop (oasis\_abort) ABORT: message = NEMO initiated abort (oasis\_abort) ABORT: on model = toyoce (oasis\_abort) ABORT: on global rank = 576 (oasis\_abort) ABORT: on local rank = 0 (oasis\_abort) ABORT: CALLING ABORT FROM OASIS LAYER NOW which appears similar to [MPICH ERROR - HadGEM3 GC5e](https://cms-helpdesk.ncas.ac.uk/t/mpich-error-hadgem3-gc5e/1842) but that issue appears not to have been solved. Would you have any advice on this? Cheers, James ---
**Author:** ![mdalvi](https://avatars.discourse-cdn.com/v4/letter/m/ad7895/32.png) [@mdalvi](https://cms-helpdesk.ncas.ac.uk/u/mdalvi)\ **Post date:** [5 January 2026 12:18 UTC](https://cms-helpdesk.ncas.ac.uk/t/mpich-oasis-error-in-coupled-run/1948/2 "2026-01-05T12:18:20Z")
Hi James, In this case (looking at “(oasis\_abort) ABORT: message = NEMO initiated abort”) it is the ocean model that has stopped and _ocean.output_ says: ```auto ===>>> : E R R O R ========== stpctl: the zonal velocity is larger than 20 m/s kt= 11043 max abs(U): 4.4092E+05, i j k: 118 289 10 ``` This is one example of NEMO blowing up so you might have to follow the [atmos dump perturbing workaround](https://code.metoffice.gov.uk/trac/moci/wiki/tips_CRgeneral#Restartingifthemodelblowsup) Mohit ---
**Author:** ![James\_Weber](https://avatars.discourse-cdn.com/v4/letter/j/e495f1/32.png) [@James\_Weber](https://cms-helpdesk.ncas.ac.uk/u/James_Weber)\ **Post date:** [5 January 2026 14:08 UTC](https://cms-helpdesk.ncas.ac.uk/t/mpich-oasis-error-in-coupled-run/1948/3 "2026-01-05T14:08:12Z")
Thanks, Mohit, I will give this ago. James ---
**Author:** ![James\_Weber](https://avatars.discourse-cdn.com/v4/letter/j/e495f1/32.png) [@James\_Weber](https://cms-helpdesk.ncas.ac.uk/u/James_Weber)\ **Post date:** [6 January 2026 18:54 UTC](https://cms-helpdesk.ncas.ac.uk/t/mpich-oasis-error-in-coupled-run/1948/4 "2026-01-06T18:54:56Z")
Thanks, Mohit, this has worked. James ---
**Author:** ![system](https://europe1.discourse-cdn.com/flex013/uploads/cms_support/original/1X/1fd2411499ffcbc299fe756cd5cdf26e44956558.png) [@system](https://cms-helpdesk.ncas.ac.uk/u/system)\ **Post date:** [5 February 2026 18:55 UTC](https://cms-helpdesk.ncas.ac.uk/t/mpich-oasis-error-in-coupled-run/1948/5 "2026-02-05T18:55:32Z")
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.