Missing WFDEI file for rainfall for April 2009

JULES
,
21

Hi Patrick
Sure move them over. I assume there is enough space.
Rich

22

Hi Rich:
Thanks. Do you know if the untarring finished properly?
I will start moving them over.
Patrick

23

Hello again JULES list:

I didn’t hear back from anyone else regarding the WFDEI data on JASMIN.
So, this is what we’re doing:

  1. The 1D-land-only from 1979-2016 WFDEI data that may be partly incomplete or with bad symbolic links will be moved from:
    /gws/nopw/j04/jules//data/WFD-EI-Forcing/
    to:
    /gws/nopw/j04/jules//data/WFD-EI-Forcing_oldCorrupt/
    This dataset will probably be deleted sometime soon.

  2. Another copy of this 1D-land-only WFDEI data has been uploaded to JASMIN by Rich Ellis. It goes from 1979-2018.
    I am putting it in:
    /gws/nopw/j04/jules//data/WFD-EI-Forcing_copy2/

Patrick McGuire

24

Hi Rich:
Hopefully you received the message I sent to the JULES listserv email list just now about this.
If not, let me know. I copied the files to the jules GWS. And I moved the old files to a new, renamed directory there.
I also set the permissions as 744, so files can’t be accidentally deleted by anyone except me. I didn’t copy the tar files.
Thanks for your help on this.

Patrick

25

Hi Rich:
I didn’t see the ancil subdirectory for WFDEI that had been in the old version, so I copied that directory from the old version.
Have the ancils changed in the 2018 version since the 2016 version?

Also, I couldn’t easily get the variable name templating working in JULES for the GPCC and the CRU precipitation. So I split the GPCC and CRU into separate subdirectories (without using symbolic links).
Hopefully this is a decent way to do things. If not, then I can change my setup.
Patrick

26

Hi Patrick,

Sounds fine to me. I am not sure how many people use these data anymore. There is an era5 version now that is maintained by ECMWF. I’ll see if it is all in the hydro-jules gws.

Cheers,

Rich

27

Thanks. Should I get access to to the hydrojules GWS if I want to try out WFDE5 or whatever it is called?

Patrick

28

Hi Patrick,

I guess it would be the easiest way to start with. If there was going to be a broader up take of the data we might move them over to the JULES GWS.

/gws/nopw/j04/hydro_jules/data/global/driving_data/wfde5/v2.0/

Cheers,

Rich

29

Hi Rich
Doug Clark just wrote and said he is using the WFDEI 2018 data today, and that I didn’t have the group permissions set right. So someone is using the data. I just fixed the permissions.
I will apply for hydro_jules GWS access then. Thanks.
Patrick

30

Patrick,

Thanks for sorting out this mess!
Is the move complete?
As it happens today I have a job that wants to use these data.
I get the error:
/gws/nopw/j04/jules/data/WFD-EI-Forcing_copy2/SWdown_WFDEI_land/SWdown_WFDEI_land_197901.nc (NetCDF error - Permission denied)

Also:
$ ls -l /gws/nopw/j04/jules/data/WFD-EI-Forcing_copy2
ls: cannot access /gws/nopw/j04/jules/data/WFD-EI-Forcing_copy2/Rainf_WFDEI_CRU_land: Permission denied
ls: cannot access /gws/nopw/j04/jules/data/WFD-EI-Forcing_copy2/Rainf_WFDEI_GPCC_land: Permission denied
ls: cannot access /gws/nopw/j04/jules/data/WFD-EI-Forcing_copy2/Snowf_WFDEI_CRU_land: Permission denied
ls: cannot access /gws/nopw/j04/jules/data/WFD-EI-Forcing_copy2/Snowf_WFDEI_GPCC_land: Permission denied
total 0
drwxr–r-- 1 pmcguire gws_jules 0 Oct 4 2018 ancils
drwxr–r-- 1 pmcguire gws_jules 0 Aug 21 2019 LWdown_WFDEI_land
drwxr–r-- 1 pmcguire gws_jules 0 Aug 21 2019 PSurf_WFDEI_land
drwxr–r-- 1 pmcguire gws_jules 0 Aug 21 2019 Qair_WFDEI_land
d??? ? ? ? ? ? Rainf_WFDEI_CRU_land
d??? ? ? ? ? ? Rainf_WFDEI_GPCC_land
d??? ? ? ? ? ? Snowf_WFDEI_CRU_land
d??? ? ? ? ? ? Snowf_WFDEI_GPCC_land
drwxr–r-- 1 pmcguire gws_jules 0 Aug 21 2019 SWdown_WFDEI_land
drwxr–r-- 1 pmcguire gws_jules 0 Aug 21 2019 Tair_WFDEI_land
drwxr–r-- 1 pmcguire gws_jules 0 Aug 21 2019 Wind_WFDEI_land

Cheers,
Doug

31

Hi Douglas:

I just changed the permissions. Do they work for you? I did:

chmod -R g+rX /gws/nopw/j04/jules//data/WFD-EI-Forcing_copy2

I didn’t see the ancil subdirectory for WFDEI that had been in the old 2016 version, so I copied that directory from the old version.

Have the ancils changed in the 2018 version since the 2016 version?

Also, I couldn’t easily get the variable name templating working in JULES for the GPCC and the CRU precipitation. So I split the GPCC and CRU into separate subdirectories (without using symbolic links).

Hopefully this is a decent way to do things. If not, then I can change my setup.

Patrick

32

Patrick,

This is looking good to me – at any rate JULES is now running and (apparently) happily reading the new WFDEI data.

I don’t know anything much about the ancil directory – and so your approach of just copying it seems reasonable to me. It looks like there are quite a few variant files in there, probably some that no one would want to/should use…but again I don’t know details. If anyone knows more it is likely Rich Ellis.

Re variable name templating – I think the separate sub-directories that you have is probably the cleanest solution – and it makes it more obvious that there are variants that can be picked up.

Cheers,
Doug

33

Hi Doug:

Excellent! I’m glad it’s working.

Patrick

34

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.