# Issue with globus transfer on archer

**URL:** <https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779>\
**Category:** Uncategorized\
**Tags:** Globus\
**Created:** [18 August 2025 10:09 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779 "2025-08-18T10:09:36Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![Emanuele\_Silvio\_Gent](https://avatars.discourse-cdn.com/v4/letter/e/e19adc/32.png) [@Emanuele\_Silvio\_Gent](https://cms-helpdesk.ncas.ac.uk/u/Emanuele_Silvio_Gent)\
**Post date:** [18 August 2025 10:09 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/1 "2025-08-18T10:09:36Z")

</div>

I have been trying to work out all morning why this pp transfer failed, I attach the job err from the u-cm655\_da191\_20181229-W\_naew-11 run. I don’t understand why there would be a conflict with a transfer with identical paths not yet completed, and what I should do?

[WARN] file:nemocicepp.nl: skip missing optional source: namelist:moose\_arch

[WARN] file:atmospp.nl: skip missing optional source: namelist:script\_arch

[WARN] file:nemocicepp.nl: skip missing optional source: namelist:script\_arch

[WARN] [SUBPROCESS]: Command: globus transfer --format unix --jmespath task\_id --recursive --fail-on-quota-errors --sync-level checksum --label u-cm655\_da191\_20081229-W\_naew-11/20081201T0000Z --verify-checksum --notify off 3e90d018-0d05-461a-bbaf-aab605283d21:/work/n02/n02/egentile/cylc-run/u-cm655\_da191\_20081229-W\_naew-11/share/cycle/20081201T0000Z a2f53b7f-1b4e-4dce-9b7c-349ae760fee0:/gws/nopw/j04/canari/users/bjharvey/archive/u-cm655\_da191\_20081229-W\_naew-11/20081201T0000Z

[SUBPROCESS]: Error = 1:

Globus CLI Error: A Transfer API Error Occurred.

HTTP status: 409

request\_id: uMmE8iLR4

code: Conflict

message: A transfer with identical paths has not yet completed

[WARN] Transfer command failed: globus transfer --format unix --jmespath ‘task\_id’ --recursive --fail-on-quota-errors --sync-level checksum --label u-cm655\_da191\_20081229-W\_naew-11/20081201T0000Z --verify-checksum --notify off 3e90d018-0d05-461a-bbaf-aab605283d21:/work/n02/n02/egentile/cylc-run/u-cm655\_da191\_20081229-W\_naew-11/share/cycle/20081201T0000Z a2f53b7f-1b4e-4dce-9b7c-349ae760fee0:/gws/nopw/j04/canari/users/bjharvey/archive/u-cm655\_da191\_20081229-W\_naew-11/20081201T0000Z

[ERROR] transfer.py: Globus Error: Network or server error occurred (Globus ReturnCode=1)

[FAIL] Command Terminated

[FAIL] Terminating PostProc…

[FAIL] transfer.py \<\<‘ **STDIN** ’

[FAIL]

[FAIL] ‘ **STDIN** ’ # return-code=1

2025-08-16T01:32:37Z CRITICAL - failed/EXIT

---

<div class="post-metadata">

**Author:** ![Juan\_Bilbao](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/juan_bilbao/32/458_2.png) [@Juan\_Bilbao](https://cms-helpdesk.ncas.ac.uk/u/Juan_Bilbao)\
**Post date:** [18 August 2025 10:22 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/2 "2025-08-18T10:22:30Z")

</div>

Hi Emanuele,

It looks like the transfer failed because another Globus task for the exact same source/destination paths is already running or retrying.

You don’t need to resubmit yet. Run globus task list and check for an ACTIVE task with the same label/paths. If it’s still retrying, just wait for it to finish.

If you want to restart cleanly, cancel it with globus task cancel and put your task id and then rerun the transfer once.

Best regards,

Juan

---

<div class="post-metadata">

**Author:** ![Emanuele\_Silvio\_Gent](https://avatars.discourse-cdn.com/v4/letter/e/e19adc/32.png) [@Emanuele\_Silvio\_Gent](https://cms-helpdesk.ncas.ac.uk/u/Emanuele_Silvio_Gent)\
**Post date:** [18 August 2025 10:41 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/3 "2025-08-18T10:41:34Z")

</div>

Hi Juan,

I terminated it from the web interface and then retriggered it from the cylc-rose suite.

But now I get a different error with globus about connection error

Bests,

Emanuele

Lmod is automatically replacing “cce/15.0.0” with “gcc/11.2.0”.

Due to MODULEPATH changes, the following have been reloaded:

1. cray-mpich/8.1.23

[WARN] file:atmospp.nl: skip missing optional source: namelist:moose\_arch

[WARN] file:nemocicepp.nl: skip missing optional source: namelist:moose\_arch

[WARN] file:atmospp.nl: skip missing optional source: namelist:script\_arch

[WARN] file:nemocicepp.nl: skip missing optional source: namelist:script\_arch

[WARN] [SUBPROCESS]: Command: globus transfer --format unix --jmespath task\_id --recursive --fail-on-quota-errors --sync-level checksum --label u-cm655\_da191\_20081229-W\_naew-11/20081201T0000Z --verify-checksum --notify off 3e90d018-0d05-461a-bbaf-aab605283d21:/work/n02/n02/egentile/cylc-run/u-cm655\_da191\_20081229-W\_naew-11/share/cycle/20081201T0000Z a2f53b7f-1b4e-4dce-9b7c-349ae760fee0:/gws/nopw/j04/canari/users/bjharvey/archive/u-cm655\_da191\_20081229-W\_naew-11/20081201T0000Z

[SUBPROCESS]: Error = 1:

Globus CLI Error: A Globus Error Occurred.

error\_type: GlobusConnectionError

message: ConnectionError on request

---

<div class="post-metadata">

**Author:** ![Juan\_Bilbao](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/juan_bilbao/32/458_2.png) [@Juan\_Bilbao](https://cms-helpdesk.ncas.ac.uk/u/Juan_Bilbao)\
**Post date:** [18 August 2025 13:43 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/4 "2025-08-18T13:43:19Z")

</div>

Hi Emanuele,

This is a GlobusConnectionError (the CLI cannot reach Globus or a collection is offline).

Can you try to check and reactivate the conectivity.

globus collection show 3e90d018-0d05-461a-bbaf-aab605283d21  
globus collection show a2f53b7f-1b4e-4dce-9b7c-349ae760fee0  
globus collection auto-activate 3e90d018-0d05-461a-bbaf-aab605283d21  
globus collection auto-activate a2f53b7f-1b4e-4dce-9b7c-349ae760fee0

If it still fails, please re-run with verbose `-v` and send the last 30 lines

Best regards,

Juan

---

<div class="post-metadata">

**Author:** ![Juan\_Bilbao](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/juan_bilbao/32/458_2.png) [@Juan\_Bilbao](https://cms-helpdesk.ncas.ac.uk/u/Juan_Bilbao)\
**Post date:** [18 August 2025 14:29 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/5 "2025-08-18T14:29:25Z")

</div>

Also please on archer2 check type these commands to get more information:

```auto
ARCHER2> module load globus-cli/3.35.2 

```

```auto
ARCHER2> globus ls 3e90d018-0d05-461a-bbaf-aab605283d21:/~/ 

```

```auto
ARCHER2> globus ls a2f53b7f-1b4e-4dce-9b7c-349ae760fee0:/~/

```

Im sharing also further instructions here:

[https://cms.ncas.ac.uk/unified-model/pptransfer-globus/](https://cms.ncas.ac.uk/unified-model/pptransfer-globus/)

Juan

---

<div class="post-metadata">

**Author:** ![Emanuele\_Silvio\_Gent](https://avatars.discourse-cdn.com/v4/letter/e/e19adc/32.png) [@Emanuele\_Silvio\_Gent](https://cms-helpdesk.ncas.ac.uk/u/Emanuele_Silvio_Gent)\
**Post date:** [18 August 2025 15:24 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/6 "2025-08-18T15:24:57Z")

</div>

Hi Juan,

This is what globus collection tells me

egentile@ln01:/work/n02/n02/egentile/cylc-run/u-cm655\_da191\_20081229-W\_naew-11/share/cycle\> globus collection show 3e90d018-0d05-461a-bbaf-aab605283d21

MissingLoginError: Missing ‘manage\_collections’ consent on an endpoint.

Please run:

globus login --gcs 01eaceb2-fdab-4509-8b6c-9ba112ab5f18

egentile@ln01:/work/n02/n02/egentile/cylc-run/u-cm655\_da191\_20081229-W\_naew-11/share/cycle\> globus collection show a2f53b7f-1b4e-4dce-9b7c-349ae760fee0

MissingLoginError: Missing ‘manage\_collections’ consent on an endpoint.

Please run:

globus login --gcs 26ee7546-0b70-42b5-8f8d-6e443323ea82

---

<div class="post-metadata">

**Author:** ![Emanuele\_Silvio\_Gent](https://avatars.discourse-cdn.com/v4/letter/e/e19adc/32.png) [@Emanuele\_Silvio\_Gent](https://cms-helpdesk.ncas.ac.uk/u/Emanuele_Silvio_Gent)\
**Post date:** [18 August 2025 19:38 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/7 "2025-08-18T19:38:33Z")

</div>

Hi Juan,

Thanks a lot for your kind help.

---

<div class="post-metadata">

**Author:** ![Juan\_Bilbao](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/juan_bilbao/32/458_2.png) [@Juan\_Bilbao](https://cms-helpdesk.ncas.ac.uk/u/Juan_Bilbao)\
**Post date:** [19 August 2025 09:23 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/8 "2025-08-19T09:23:52Z")

</div>

Hi Emanuele,

Could you please try point 3 & 5 on this page: [https://cms.ncas.ac.uk/unified-model/pptransfer-globus/](https://cms.ncas.ac.uk/unified-model/pptransfer-globus/) to authenticate to globus. Then check if everything runs ok. This should fix the `manage_collections` consent problem.

Best regards,

Juan

---

<div class="post-metadata">

**Author:** ![Emanuele\_Silvio\_Gent](https://avatars.discourse-cdn.com/v4/letter/e/e19adc/32.png) [@Emanuele\_Silvio\_Gent](https://cms-helpdesk.ncas.ac.uk/u/Emanuele_Silvio_Gent)\
**Post date:** [19 August 2025 10:59 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/9 "2025-08-19T10:59:34Z")

</div>

Hi Juan

Thanks it got fixed now!

Emanuele

---

<div class="post-metadata">

**Author:** ![Juan\_Bilbao](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/juan_bilbao/32/458_2.png) [@Juan\_Bilbao](https://cms-helpdesk.ncas.ac.uk/u/Juan_Bilbao)\
**Post date:** [19 August 2025 11:46 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/10 "2025-08-19T11:46:24Z")

</div>

Hi Emanuele,

Good that it got solved now!

Best regards,

Juan

---

<div class="post-metadata">

**Author:** ![Juan\_Bilbao](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/juan_bilbao/32/458_2.png) [@Juan\_Bilbao](https://cms-helpdesk.ncas.ac.uk/u/Juan_Bilbao)\
**Post date:** [19 August 2025 11:46 UTC](https://cms-helpdesk.ncas.ac.uk/t/issue-with-globus-transfer-on-archer/1779/11 "2025-08-19T11:46:29Z")

</div>


