James
Did you not get the gridftp sorted out with JASMIN?
Grenville
Hi Grenville,
I think Matt from Jasmin looked into it but wasn’t able to see anything wrong.
Best,
James
Hi James
Please can you generate a new credential and try the command line tests that Ros showed earlier.
If the problem persists, let’s try creating a new ARCHER2 account & try again - that may eliminate ARCHER2 as a possible source.
Grenville
Hi Grenville,
I generated a new credential and tried running a suite with pptransfer on but that task failed with the same error as I had had previously.
In terms of making a new Archer2 account, is it possible to hold onto my current one as well since that works well aside from the pptransfer issue?
Thanks,
James
James
Yes that’s OK - create another one for testing through SAFE.
Grenville
Thanks, Grenville. I’ve made another account using my personal email address rather than my Sheffield address, requested access to the n02 project and a username of jweber_test.
I’ve got a screen saying:
"New Account requested
Your account jweber_test@archer2 has been requested, the project’s principal investigator or a project manager will be informed of your request and you will be contacted once your machine account has been activated."
Is the correct approach?
Best,
James
Just had an email confirming approval thank. When I try to ssh into Archer2 using my new test account my ssh passphrase is fine but I’m not sure which password it is asking for. Is it the password of my new Archer2 account (i.e that registered my personal email)?
Thanks,
James
Sorry, just seen the extra guidance re default password. I have used that and switched it to a new one and can now login in to Archer2.
James
Any luck with gridftp?
Hi Grenville,
I made a new suite, u-cw947 (copy of u-cu408 which runs) and changed the username to jweber_test and archer archive location to /work/n02/n02/jweber_test/archive but I’m getting the below error message when trying to run it.
[FAIL] ssh -oBatchMode=yes -n jweber_test@login.archer2.ac.uk env\ ROSE_VERSION=2019.01.3\ CYLC_VERSION=7.8.12\ bash\ -l\ -c\ '"$0"\ "$@"'\ rose\ suite-run\ -vv\ -n\ u-cw947\ –run=run\ –remote=uuid=cb88332f-6519-4ce3-a2b1-dd0df24094e2,now-str=20230512T115336Z,root-dir='$DATADIR' # return-code=255, stderr=
[FAIL] Permission denied (publickey).
I haven’t done anything with my archerum key. Should I have made changes there?
Thanks,
James
James
The plan was just to see if you could get gridftp to work - I thought you would create a credential and try the commands that you you ran on your old account. It’s not possible to submit jobs to the new ARCHER account since there is no archerum key.
Grenville
Hi Grenville,
Sorry, my mistake I had misunderstood. I have since logged on to archer2 with my new account, navigated to /work/n02/n02/jweber_test, and attempted the first command in Configuring PPTransfer.
However, when I ran: $UMDIR/bin/onlineca-get-trustroots-wget.sh -U https://slcs.jasmin.ac.uk/trustroots/ -b
The result was: -bash: /bin/onlineca-get-trustroots-wget.sh: No such file or directory
Thanks,
James
James
the new account doesn’t have the environment set, type
/work/y07/shared/umshared/bin/on... instead of $UMDIR/bin/on...
you will also need to
module load gct
before trying the gridftp commands
Grenville
Thanks, Grenville. It looks like the same issue as before is occurring. For example, when I run:
globus-url-copy -cred /work/n02/n02/jweber_test/cred.jasmin -vb -list gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/mass_extracts
The correct output of “mass_extracts” is returned.
However, when I run
globus-url-copy -cred /work/n02/n02/jweber_test/cred.jasmin -vb -list gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/mass_extracts/
I get the same failure message as I did with my standard Archer2 account.
error: globus_ftp_client: the server responded with an error
550 550-GlobusError: v=1 c=PATH_NOT_FOUND
550-GridFTP-Errno: 2
550-GridFTP-Reason: System error in stat
550-GridFTP-Error-String: No such file or directory
550 End.
Ros said both commands worked for her so it looks like the problem is on the Jasmin end.
James
Please can you allow me read permission on your home directory
chmod -R g+rX /home/users/jmw240
Grenville
Hi Grenville,
I’ve done that thanks. I’ve just started to get failures when I try to extracts from the Met Office’s MASS system onto Jasmin with the following error:
“Unable to load Moose credentials. Please check credential file permissions. Only file owner should have read and write access”
Could the permission change command have caused this?
Thanks,
James
Hi James
Sounds likely, try changing permissions on the moose credential file.
Please retry the globus command, but on a directory that exists in your home space
globus-url-copy -cred /work/n02/n02/jweber_test/cred.jasmin -vb -list gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/**mass_extracts**/
glister@sci2$ ls /home/users/jmw240/mass_extracts/
ls: cannot access /home/users/jmw240/mass_extracts/: No such file or directory
Grenville
Hi Grenville,
Thanks, I ran “chmod 700” on my mass_extracts file (which is my group workspace not my home) and contents. The permissions are listed as drwx–S— and -rwx------ for subdirectories and files respectively but the extract problems persists.
Am I right in saying the “chmod -R g+rX /home/users/jmw240” only targets files in my home, not my gws?
In terms of gridftp, sorry I realise I was looking at a non-existent file in my home directory last time. I used /home/users/jmw240/emissions this time which does exist and has permissions drwxr-xr-x.
When I ran:
globus-url-copy -cred /work/n02/n02/jweber_test/cred.jasmin -vb -list gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/emissions
The output was:
gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/emissions
emissions
But when I run
globus-url-copy -cred /work/n02/n02/jweber_test/cred.jasmin -vb -list gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/emissions/
The result was
gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/emissions/
error: globus_ftp_client: the server responded with an error
500 500-Command failed. : an authentication operation failed
500-globus_gsi_callback_module: Could not verify credential
500-globus_gsi_callback_module: Error with signing policy
500-globus_gsi_callback_module: Error in OLD GAA code: The subject of the certificate “/DC=uk/DC=ac/DC=jasmin/O=STFC RAL/CN=JASMIN” does not match the signing policies defined in /home/users/jmw240/.globus/certificates/7ed47087.signing_policy
500 End.
Not being able to do the pp transfer isn’t the end of the world as I can do a reasonably rapid scp over.
James
Hi James
I don’t have a .globus directory on JASMIN, nor does Ros - please “mv” your .globus directory to something else & try one more time.
Grenville
Hi Grenville,
Sorry, I think I put the .globus file there as a test a couple of months ago. I have now moved it.
Running:
globus-url-copy -cred /work/n02/n02/jweber_test/cred.jasmin -vb -list gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/emissions/
returns:
gsiftp://gridftp1.jasmin.ac.uk/home/users/jmw240/emissions/
.ipynb_checkpoints/
CO_anthropogenic_1849_2015_time_series.nc
CO_combined_anthropogenic_1985_2015_time_series.nc
Emiss_analysis.ipynb
I think this what I should get as it matches Ros’ results. I will try to do a full pptransfer from Archer2.
Alan from Jasmin has helpfully reset the permissions on on the moose credentials.
Thank you for your help. I will let you know how the pptransfer goes.
James