Opened 6 weeks ago

Closed 13 days ago

#3137 closed help (answered)

memory error on ARCHER work space

Reported by: luciad Owned by: um_support
Component: Other Keywords:
Cc: Platform: ARCHER
UM Version:

Description

Hello,

I am trying to run a python script on /work/n02/n02/ but my run fails with MemoryError?. I am sure it's not a problem of exceeding quota, since I have 2Tb available, and yesterday it was working, and I don't know what other reason there could be (except full RAM memory). Is there something that can be done about it?

Regards,
Lucia

Change History (4)

comment:1 Changed 6 weeks ago by dcase

If you're running heavy duty scripts on the login nodes, please don't do this. Submit them as a job to the queue- you'll be able to get more memory (RAM) here.
You can see all the options here: https://www.archer.ac.uk/documentation/user-guide/batch.php

Sorry if I've misunderstood you.

comment:2 Changed 6 weeks ago by luciad

It's loading a 5Gb pp file with iris considered heavy duty?
But thank you for the alternative…although I was trying to avoid queuing since it's quite an urgency to have this tested, and the queues are very slow these days.

Lucia

comment:3 Changed 6 weeks ago by dcase

There are lots of options with the queues, so I would read them and find the best one for you if I were you.

If you want to do things from the command line, you can get to the post processing nodes from the login nodes through ssh -Y espp1 (or espp2) and you can use those for data manipulation.

comment:4 Changed 13 days ago by ros

  • Resolution set to answered
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.