Opened 3 years ago
Closed 3 years ago
#2378 closed help (answered)
LOTUS and Jasmin VM
Reported by: | mvguarino | Owned by: | um_support |
---|---|---|---|
Component: | Data | Keywords: | JASMIN, VM, LOTUS |
Cc: | Platform: | JASMIN | |
UM Version: |
Description
Hello,
I would like to know if it possible to run batch jobs from the JASMIN VM on the RDF.
I tried to submit jobs to LOTUS from the VM but the 'bsub' command is not recognized.
Thanks,
Vittoria
Change History (6)
comment:1 Changed 3 years ago by andy
comment:2 Changed 3 years ago by mvguarino
Hi Andy,
What a horrible news you gave me.
Would it be possible to run a batch job on ARCHER instead? (I tried, but again the qsub command is not found)
Vittoria
comment:3 Changed 3 years ago by andy
Hi Vittoria,
Could you explain what you're trying to do? Once we understand we'll be able to advise you better.
Thanks
Andy
comment:4 Changed 3 years ago by mvguarino
Hi,
I've got a python script, using IRIS, to process some model data currently on the RDF. The scripts does some re-gridding, calculates means etc.
It takes about 1 minute per file to run, and I have got more than 300 monthly files (the number will increase).
As it is too slow, I was thinking to run the script on multiple cores.
Vittoria
comment:5 Changed 3 years ago by andy
Hi Vittoria,
As we don't have a batch system on jasmin.rdf.ac.uk I would recommend multiple logins in this instance. If you had four concurrent sessions running in four different windows running your data through iris then you'd get through your data in 300 / 4 = 75 minutes.
Andy
comment:6 Changed 3 years ago by willie
- Resolution set to answered
- Status changed from new to closed
- UM Version <select version> deleted
Hi Vittoria,
No, it's not possible to submit batch jobs from the jasmin.rdf.ac.uk to the LOTUS queue on the jasmin@CEDA system. You'll need to be on the jasmin sci nodes to do this.
Please get back to us if you need to discuss this further.
Thanks
Andy