CIRRUS home folder empty

Hi,

I transferred all of my PUMA2 data to the folder /mnt/cephfs/n02/n02-puma2/s2261584/ on PUMA2 as instructed and expected this to be on CIRRUS today at /home/n02/n02/s2261584 but this folder is empty.

Thanks,

Hannah

Also a second question, the shared folder on Archer2 which the jobs call, will this be transferred to Cirrus too? Or do I need to take copies of files on there I use

Hi Hannah,

/mnt/cephfs/n02/n02-puma2/s2261584/branches is the new PUMA2 home directory and will now be visible as /home/n02/n02/s2261584/branches when you login to PUMA2 from Cirrus. This is separate from your Cirrus home directory.

As per ARCHER2 your new PUMA2 home directory is also visible from Cirrus at: /home/n02/n02-puma2/s2261584

Sorry this is confusing, but PUMA2 is now effectively configured with Cirrus in the same way it was with ARCHER2. Don’t know if that helps or not.

Cheers,
Ros

Files you copied to /nscds/n02/n02 on ARCHER2 are located at /epccfs/n02/n02 on Cirrus. /epccfs/ the Cirrus equivalent of the ARCHER2 /work disk and is the disk your jobs will use.

Or do you mean by “shared folder” those file that are under /work/n02/n02/shared on ARCHER2? In which case you will need to copy those to Cirrus too.

Cheers,
Ros

Hi Ros,

Thanks for this, a few things:

-I can see the files on /home/n02/n02-puma2/s2261584 now thanks

-I’m not sure how to ssh into puma/ what the password is? I’ve never been prompted for this before?

-I mean this folder /work/y07/shared/umshared? I think this is too many files for my own account but I had thought everyone would need to use files in here?

Thanks,

Hannah

Also, now to copy things to /epccfs/ what is the recommended method as I did not know how much storage I had on CIRRUS so I put all my work folder from archer2 on JASMIN

Hi Hannah,

You need to use your cirrus ssh-key to get from Cirrus to PUMA2.
[On ARCHER2 you could either use your archer2 key or configure a passphraseless key.]

The easiest way to connect to PUMA2 is to configure you local machine to hop via Cirrus.

In your ~/.ssh/config file on your laptop/desktop.

# PUMA2
Host puma2
User <your-cirrus-username>
IdentityFile ~/.ssh/<your-cirrus-key>
ProxyJump cirrus

# Cirrus
Host cirrus
Hostname login.cirrus.ac.uk
IdentityFile ~/.ssh/<your-cirrus-key>
ForwardX11 yes

Then you should be able to type ssh puma2 and land straight on PUMA2 (being prompted for your TOTP as required).

You may already have similar to this for ARCHER2 if you used the cylc 8 web ui.

/work/y07/shared/umshared has been copied over to Cirrus and is under /epccfs/y07/shared/umshared

Cheers,
Ros

You copy data between Cirrus and JASMIN in the same way as you did between ARCEHR2 and JASMIN; suggest either use rsync or globus.

There is information on how to transfer data on the Cirrus website:

Hi Ros,

Thanks, I think the issue is this in the email from this morning: Once you have your Cirrus account, you can request access to PUMA2. In SAFE go to “Login accounts → select your username → Add Machine → select puma2 → click Join”. When I click login accounts there isn’t this option, only ‘request login account’ and my cirrus and archer accounts? I can see puma2 listed on my cirrus list when I click this option without needing to request it however.

I tried your script adding to my .ssh/config file on my local terminal:

PUMA2

Host puma2
User s2261584
IdentityFile ~/.ssh/id_rsa
ProxyJump cirrus

Cirrus

Host cirrus
Hostname login.cirrus.ac.uk
IdentityFile ~/.ssh/id_rsa
ForwardX11 yes

I can login to cirrus with ssh s2261584@login.cirrus.ac.uk but not ssh cirrus or ssh puma2. On safe, the public version of this key is the one that is listed in my account so I assumed it was this but it isn’t working so maybe I’ve missed a step?

Great about the shared folder - thanks!

Ok, I hadn’t realised globus was also available, thanks.

Cheers,

Hannah

Hi Hannah,

You already had a Cirrus account before the maintenance yesterday so you don’t need to request access to PUMA2 again you already have it. Hence why you were able to copy your data to the new PUMA2 home directory.

Add the line below to the Cirrus section of your .ssh/config file and try again.

User s2261584

Cheers,
Ros

Great that lets ssh cirrus work but ssh puma2 still requests a password? Sorry if I have totally misplaced this, I probably have, but I’ve never been prompted for a password before.

Thanks,

Hannah

Hi Hannah,

I think it’s because it doesn’t have your cirrus key to do the last hop from cirrus to puma2. Copy your cirrus ssh-key (from message above that looks to be ~/.ssh/id_rsa) to /home/n02/n02/s2261584/.ssh on Cirrus.

Make sure your ~/.ssh directory is only readable to you.

Cirrus> ls -ld .ssh
drwx--S--- 2 ros n02 8 Nov 19 17:10 .ssh/

Try again and I think you will then be prompted for your cirrus passphrase again and then you will be logged in to puma2.

If you store your cirrus ssh-key in an ssh-agent on your laptop it will pass this through and you won’t be prompted for your passphrase at all.

Cheers,
Ros

OK so having been playing around with my own setup you definitely shouldn’t need your Cirrus ssh-key on Cirrus. There are no passwords for PUMA2, so for some reason the ssh is not taking the cirrus key with it. It may be easiest for us to do a video call to sort this out.