# Suite submission fails at every iteration

**URL:** <https://cms-helpdesk.ncas.ac.uk/t/suite-submission-fails-at-every-iteration/1711>\
**Category:** Unified Model\
**Tags:** Monsoon2\
**Created:** [22 May 2025 13:42 UTC](https://cms-helpdesk.ncas.ac.uk/t/suite-submission-fails-at-every-iteration/1711 "2025-05-22T13:42:42Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![MYoshioka](https://avatars.discourse-cdn.com/v4/letter/m/c5a1d2/32.png) [@MYoshioka](https://cms-helpdesk.ncas.ac.uk/u/MYoshioka)\
**Post date:** [22 May 2025 13:42 UTC](https://cms-helpdesk.ncas.ac.uk/t/suite-submission-fails-at-every-iteration/1711/1 "2025-05-22T13:42:42Z")

</div>

Hi. I’ve been running UM vn13.7 global suites on Monsoon2 and they were running fine until recently, but some of my latest suites stop at the end of every cycle for some reason.

u-dq018 and u-dq112 are currently running fine while u-dq115 and u-dq162 are the ones with this problem. These suites are very similar to each other and have only small scientific differences, I believe.

cylc says ‘submission failed’ for postproc of that cycle and atmos\_main of the next cycle. Other than that I don’t see any error message. Neither job.err or job.out seems to have been created.

If I manually trigger run on these failed jobs, they run fine for a cycle and then stop for the same reason. That means they require my constant attention and are stopping for hours over night.

Please could you help me?

Thanks,  
Masaru

---

<div class="post-metadata">

**Author:** ![RosalynHatcher](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/rosalynhatcher/32/11_2.png) [@RosalynHatcher](https://cms-helpdesk.ncas.ac.uk/u/RosalynHatcher)\
**Post date:** [22 May 2025 16:18 UTC](https://cms-helpdesk.ncas.ac.uk/t/suite-submission-fails-at-every-iteration/1711/2 "2025-05-22T16:18:00Z")

</div>

Hi Masaru,

This is an intermittent issue caused by the way the suite is set up resulting in cylc trying to ssh from xcs to itself which isn’t needed and cause issues. Someone else had this issue very recently too.

In `site/monsoon.rc` change in the `[[HPC]]` section:

Replace the line:  
`host = $(rose host-select xcs-c)`  
with  
`host = localhost`

Regards,  
Ros.

---

<div class="post-metadata">

**Author:** ![MYoshioka](https://avatars.discourse-cdn.com/v4/letter/m/c5a1d2/32.png) [@MYoshioka](https://cms-helpdesk.ncas.ac.uk/u/MYoshioka)\
**Post date:** [23 May 2025 13:38 UTC](https://cms-helpdesk.ncas.ac.uk/t/suite-submission-fails-at-every-iteration/1711/3 "2025-05-23T13:38:34Z")

</div>

Hi Ros.  
Oh, that’s great. It seems to be working.  
Thanks a lot for your help!  
Masaru

---

<div class="post-metadata">

**Author:** ![system](https://europe1.discourse-cdn.com/flex013/uploads/cms_support/original/1X/1fd2411499ffcbc299fe756cd5cdf26e44956558.png) [@system](https://cms-helpdesk.ncas.ac.uk/u/system)\
**Post date:** [24 May 2025 13:38 UTC](https://cms-helpdesk.ncas.ac.uk/t/suite-submission-fails-at-every-iteration/1711/4 "2025-05-24T13:38:55Z")

</div>

This topic was automatically closed 24 hours after the last reply. New replies are no longer allowed.