memory error on ARCHER work space

[luciad]

Hello,

I am trying to run a python script on /work/n02/n02/ but my run fails with MemoryError?. I am sure it's not a problem of exceeding quota, since I have 2Tb available, and yesterday it was working, and I don't know what other reason there could be (except full RAM memory). Is there something that can be done about it?

Regards,
Lucia

[dcase]

If you're running heavy duty scripts on the login nodes, please don't do this. Submit them as a job to the queue- you'll be able to get more memory (RAM) here.
You can see all the options here: ​https://www.archer.ac.uk/documentation/user-guide/batch.php

Sorry if I've misunderstood you.

[luciad]

It's loading a 5Gb pp file with iris considered heavy duty?
But thank you for the alternative…although I was trying to avoid queuing since it's quite an urgency to have this tested, and the queues are very slow these days.

Lucia

[dcase]

There are lots of options with the queues, so I would read them and find the best one for you if I were you.

If you want to do things from the command line, you can get to the post processing nodes from the login nodes through ssh -Y espp1 (or espp2) and you can use those for data manipulation.