# Missing CRU-NCEP-v7-n96e file for 1913 in the JASMIN jules GWS **URL:** \ **Category:** JULES\ **Tags:** JASMIN\ **Created:** [2 March 2023 11:43 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931 "2023-03-02T11:43:56Z")\ **Posts on this page:** 18\ **Page:** 1
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [2 March 2023 11:43 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/1 "2023-03-02T11:43:56Z")
Hi AndyW and CarolinaDR (cc: DaveC): (copied from an email I sent) There is a missing file in the GL7 driving data on JASMIN for suite u-bb316: /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/[cruncepv7\_vwind\_1913\_n96e.nc](http://cruncepv7_vwind_1913_n96e.nc/) AndyW is the owner/creator of this directory. Can you transfer this file from somewhere? Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [2 March 2023 12:31 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/2 "2023-03-02T12:31:08Z")
Hi Andy and Carolina: In the meantime, I will try to run the suite starting in 1914 instead of 1860. It probably won’t give the right results, but I can see if the suite works with the other changes I made. Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [29 March 2023 15:26 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/3 "2023-03-29T15:26:04Z")
Hi Andy and Carolina: Did you have a chance to look into this missing data yet? Or is there someone else I should contact about this? I think there is a 1940 data file missing, in addition to the 1913 data file. Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [29 March 2023 15:26 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/4 "2023-03-29T15:26:38Z")
Hi Patrick, File should have been updated. Let me know any issues. Dr Andy Wiltshire ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [29 March 2023 15:27 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/5 "2023-03-29T15:27:20Z")
Hi again, Andy & Carolina: Can you look into that missing 1940 data file sometime? Thanks! Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [29 March 2023 15:27 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/6 "2023-03-29T15:27:38Z")
Okay, done that one as well. It would be good to know if there are others. Dr Andy Wiltshire ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [29 March 2023 15:27 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/7 "2023-03-29T15:27:54Z")
Thanks, Andy! I will keep an eye out for for other missing files. I don’t know why they are missing. Maybe we need to get rid of group-write access for these files, if that is the current access. Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [14 April 2023 10:19 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/8 "2023-04-14T10:19:05Z")
Hi Andy & Carolina: I tried the run again of the u-bx723 suite which is derived from the u-bb316 GL7 suite, now starting from 1860 instead of 1914. It had previously failed in 1940. It now gets to 1948 before failing due to missing data. This file is missing: /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_swdown\_1948\_n96e.nc I guess there might be other files missing too. Maybe it would be easier to just replace all the data all at once? Do you have an original copy of the data? Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [18 April 2023 19:48 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/9 "2023-04-18T19:48:22Z")
Hi AndyW & Carolina: Do you know where I can get an original copy of the driving data? Then I could do this myself. I looked on Monsoon in the path /data/d05/hadaw/HadGEM3-GA6/Ancils/GA7\_Ancil/ but that appears to be a restricted Met Office path. I found two more missing files, that makes at least 5 in total, and you’ve already replaced 2 of them. These are the two other missing files (there are likely more): ```auto /gws/nopw/j04/jules/data/CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7_tair_1966_n96e.nc /gws/nopw/j04/jules/data/CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7_lwdown_1963_n96e.nc ``` Patrick ---
**Author:** ![system](https://europe1.discourse-cdn.com/flex013/uploads/cms_support/original/1X/1fd2411499ffcbc299fe756cd5cdf26e44956558.png) [@system](https://cms-helpdesk.ncas.ac.uk/u/system)\ **Post date:** [18 May 2023 19:48 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/10 "2023-05-18T19:48:38Z")
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed. ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [24 May 2023 16:59 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/11 "2023-05-24T16:59:41Z")
---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [24 May 2023 17:04 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/12 "2023-05-24T17:04:04Z")
Someone noticed the ticket I had about this on the NCAS CMS Helpdesk, and they sent me a directory with another copy of the data.: I just compared that directory to the official one I have been using. I used this set of 3 commands to compare them: dir1= set this to the other copy dir2=/gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e for f1 in ${dir1}/\*; do f2=“${dir2}/${f1#${dir1}/}”; [! -e “$f2”] && printf ‘%s\n’ “$f2”; done This is the result: /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_lwdown\_1963\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_lwdown\_1982\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_press\_1972\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_press\_2012\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_qair\_2005\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_qair\_2010\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_swdown\_1948\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_swdown\_1975\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_tair\_1966\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_tair\_1990\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_tair\_1996\_n96e.nc /gws/nopw/j04/jules/data//CRU-NCEP-v7/CRU-NCEP-v7-n96e/cruncepv7\_uwind\_1999\_n96e.nc I tried to copy those files to the official database, but the folder belongs to AndyW, so I don’t have permission to update the files. Patrick ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [19 February 2024 21:51 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/13 "2024-02-19T21:51:17Z")
Hi DaveC: Since we now have a full CRU-NCEP-v7 dataset available, can you move this directory from: /gws/nopw/j04/jules/data/CRU-NCEP-v7/ to: /gws/nopw/j04/jules/data/CRU-NCEP-v7\_oldCorrupt ? And can you then move this directory: /gws/nopw/j04/jules/data/CRU-NCEP-v7\_copy2/ to: /gws/nopw/j04/jules/data/CRU-NCEP-v7/ You can recursively change the owner of the files in the last directory to yourself, if you want. I have made those files in that directory read-only, possibly to help to avoid files going AWOL like before. I have tested the suite u-da046 with this copy2 of the data. But there are other people’s GL7 N96 suites that might get tripped up by missing files in the original copy of this CRU-NCEP-v7 dataset. Patrick ---
**Author:** ![dcase](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/dcase/32/468_2.png) [@dcase](https://cms-helpdesk.ncas.ac.uk/u/dcase)\ **Post date:** [20 February 2024 10:35 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/14 "2024-02-20T10:35:20Z")
If you have access to that directory, why do you want me to copy the directories? You have permission yourself, no? ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [20 February 2024 11:16 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/15 "2024-02-20T11:16:59Z")
Hi DaveC I want to replace the corrupt copy that has missing files. I don’t have permission to do that. Patrick ---
**Author:** ![dcase](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/dcase/32/468_2.png) [@dcase](https://cms-helpdesk.ncas.ac.uk/u/dcase)\ **Post date:** [20 February 2024 12:34 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/16 "2024-02-20T12:34:55Z")
I’ve done that. Do you want to keep the \_oldCorrupt directory? I’ve not looked into this, just done your commands. If you’d like to have access to the julesadmin unix group, I can get you that? You don’t have to if you don’t want to. ---
**Author:** ![pmcguire](https://avatars.discourse-cdn.com/v4/letter/p/b782af/32.png) [@pmcguire](https://cms-helpdesk.ncas.ac.uk/u/pmcguire)\ **Post date:** [20 February 2024 12:55 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/17 "2024-02-20T12:55:10Z")
Thanks, Dave! That’s perfect. I think we should keep the prior copy of the data for awhile, in case there are problems. I don’t think there are enough times that I would need julesadmin privilege, so I will hold off on that for now. Patrick ---
**Author:** ![RosalynHatcher](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/rosalynhatcher/32/11_2.png) [@RosalynHatcher](https://cms-helpdesk.ncas.ac.uk/u/RosalynHatcher)\ **Post date:** [28 May 2024 13:43 UTC](https://cms-helpdesk.ncas.ac.uk/t/missing-cru-ncep-v7-n96e-file-for-1913-in-the-jasmin-jules-gws/931/18 "2024-05-28T13:43:58Z")