# Memory space error at recon stage

**URL:** <https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442>\
**Category:** Unified Model\
**Created:** [10 June 2024 11:03 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442 "2024-06-10T11:03:24Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![mfleg](https://avatars.discourse-cdn.com/v4/letter/m/43a26b/32.png) [@mfleg](https://cms-helpdesk.ncas.ac.uk/u/mfleg)\
**Post date:** [10 June 2024 11:03 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/1 "2024-06-10T11:03:24Z")

</div>

Hi, I’ve been trying to run a UKESM1.0 AMIP version of the UM with some changed inputs, working in u-de347. For now, I am just trying to run one month of the model to check it works with my changes. However, I have been getting this error for recon:

lib-4205 : UNRECOVERABLE library error  
The program was unable to request more memory space.  
tcmalloc: large alloc 1441714830712012800 bytes == (nil)

My jobs have also been stuck in queues for a long time; last time it took six days just to get to the (failed) recon stage; it seems like the jobs are slower with every iteration I try. I don’t think I’ve been overusing the queues (as I am literally just running this one simple job every few days), so I don’t think I would be getting deprioritised for that reason. It’s really frustrating because it’s now taking weeks just to figure out if my model set up works.

Any advice would be appreciated!

---

<div class="post-metadata">

**Author:** ![grenville](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/grenville/32/29_2.png) [@grenville](https://cms-helpdesk.ncas.ac.uk/u/grenville)\
**Post date:** [10 June 2024 11:24 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/2 "2024-06-10T11:24:05Z")

</div>

It looks like the reconfiguration is trying to read a file that has the wrong endianness. What inputs did you change?

Grenville

---

<div class="post-metadata">

**Author:** ![mfleg](https://avatars.discourse-cdn.com/v4/letter/m/43a26b/32.png) [@mfleg](https://cms-helpdesk.ncas.ac.uk/u/mfleg)\
**Post date:** [10 June 2024 13:02 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/3 "2024-06-10T13:02:56Z")

</div>

Hi Grenville, thanks for your reply.

I am trying to use my own values for surface albedo (stash requests 244 and 245). The original albedo file used by the model, when ancil file is not specified, is a .land file. I haven’t been able to figure out what format that is exactly, but I am inputting a netcdf file with a manually added .land extension. I’m not sure this is the way to go to be honest - I had a discussion with Patrick about it here: [Changing albedo climatology in JULES](https://cms-helpdesk.ncas.ac.uk/t/changing-albedo-climatology-in-jules/1368).

The file I am inputting is a copy of one of the albedo files in /work/y07/shared/umshared/ancil/atmos - I believe that is the destination the files are normally taken from when not manually specified - with some changes to the values.

---

<div class="post-metadata">

**Author:** ![grenville](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/grenville/32/29_2.png) [@grenville](https://cms-helpdesk.ncas.ac.uk/u/grenville)\
**Post date:** [10 June 2024 14:33 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/4 "2024-06-10T14:33:11Z")

</div>

Please allow us read permissions on your /work and /home spaces on ARCHER2

on an ARCHER2 login node

chmod -R g+rX /home/n02/n02/mfleg  
chmod -R g+rX /work/n02/n02/mfleg

---

<div class="post-metadata">

**Author:** ![mfleg](https://avatars.discourse-cdn.com/v4/letter/m/43a26b/32.png) [@mfleg](https://cms-helpdesk.ncas.ac.uk/u/mfleg)\
**Post date:** [10 June 2024 15:10 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/5 "2024-06-10T15:10:57Z")

</div>

Thanks Grenville, I’ve done that now

---

<div class="post-metadata">

**Author:** ![grenville](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/grenville/32/29_2.png) [@grenville](https://cms-helpdesk.ncas.ac.uk/u/grenville)\
**Post date:** [11 June 2024 15:29 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/6 "2024-06-11T15:29:29Z")

</div>

Michaela

Ancillary files are in proprietary UM fields-file format (the .land extension is just a convenience and has no relevance to the file format.)

I think there is an easier way to create your own ancillary file for stash items 244 and 245.

1. use xconv to convert the currently used albedo ancil file into a netcdf file
2. use netcdf4 to change the data but preserve all metadata, variable names etc
3. use xancil to convert the modified netcdf file back to ancillary file format.

I ran a test case, without step 2, starting from (arbitrarily) /work/y07/shared/umshared/ancil/atmos/n96e/general\_land/GlobAlbedo/v2/qrclim.land that worked without any problems.

xconv (very intuitive) and xancil ([Xancil 0.58 documentation](https://ncas-cms.github.io/xancil-doc/singlehtml/index.html)) are both installed on ARCHER2.

Grenville

---

<div class="post-metadata">

**Author:** ![mfleg](https://avatars.discourse-cdn.com/v4/letter/m/43a26b/32.png) [@mfleg](https://cms-helpdesk.ncas.ac.uk/u/mfleg)\
**Post date:** [1 July 2024 12:37 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/7 "2024-07-01T12:37:52Z")

</div>

Hi Grenville,

Thanks for this - this seems to have solved my issue as far as I can tell. I’ve been trying to test it and I am now running into another problem, getting this error:

? Error code: 1  
? Error from routine: portio2a:flush\_unit\_buffer  
? Error message: Failed in output\_buffer()  
? Error from processor: 0  
? Error number: 72

It seems to be a memory space issue. Would it be possible to increase my /work quota, please?

---

<div class="post-metadata">

**Author:** ![grenville](https://dub1.discourse-cdn.com/flex013/user_avatar/cms-helpdesk.ncas.ac.uk/grenville/32/29_2.png) [@grenville](https://cms-helpdesk.ncas.ac.uk/u/grenville)\
**Post date:** [1 July 2024 13:17 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/8 "2024-07-01T13:17:17Z")

</div>

increased to 1TB (enough?)

Grenville

---

<div class="post-metadata">

**Author:** ![mfleg](https://avatars.discourse-cdn.com/v4/letter/m/43a26b/32.png) [@mfleg](https://cms-helpdesk.ncas.ac.uk/u/mfleg)\
**Post date:** [1 July 2024 13:29 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/9 "2024-07-01T13:29:59Z")

</div>

Should be enough, thank you!

---

<div class="post-metadata">

**Author:** ![system](https://europe1.discourse-cdn.com/flex013/uploads/cms_support/original/1X/1fd2411499ffcbc299fe756cd5cdf26e44956558.png) [@system](https://cms-helpdesk.ncas.ac.uk/u/system)\
**Post date:** [31 July 2024 13:30 UTC](https://cms-helpdesk.ncas.ac.uk/t/memory-space-error-at-recon-stage/1442/10 "2024-07-31T13:30:05Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
