Opened 14 months ago
Closed 13 months ago
#3137 closed help (answered)
memory error on ARCHER work space
Reported by: | luciad | Owned by: | um_support |
---|---|---|---|
Component: | Other | Keywords: | |
Cc: | Platform: | ARCHER | |
UM Version: |
Description
Hello,
I am trying to run a python script on /work/n02/n02/ but my run fails with MemoryError?. I am sure it's not a problem of exceeding quota, since I have 2Tb available, and yesterday it was working, and I don't know what other reason there could be (except full RAM memory). Is there something that can be done about it?
Regards,
Lucia
Change History (4)
comment:1 Changed 14 months ago by dcase
comment:2 Changed 14 months ago by luciad
It's loading a 5Gb pp file with iris considered heavy duty?
But thank you for the alternative…although I was trying to avoid queuing since it's quite an urgency to have this tested, and the queues are very slow these days.
Lucia
comment:3 Changed 14 months ago by dcase
There are lots of options with the queues, so I would read them and find the best one for you if I were you.
If you want to do things from the command line, you can get to the post processing nodes from the login nodes through ssh -Y espp1 (or espp2) and you can use those for data manipulation.
comment:4 Changed 13 months ago by ros
- Resolution set to answered
- Status changed from new to closed
If you're running heavy duty scripts on the login nodes, please don't do this. Submit them as a job to the queue- you'll be able to get more memory (RAM) here.
You can see all the options here: https://www.archer.ac.uk/documentation/user-guide/batch.php
Sorry if I've misunderstood you.