LOTUS and Jasmin VM

[mvguarino]

Hello,

I would like to know if it possible to run batch jobs from the JASMIN VM on the RDF.

I tried to submit jobs to LOTUS from the VM but the 'bsub' command is not recognized.

Thanks,

Vittoria

[andy]

Hi Vittoria,

No, it's not possible to submit batch jobs from the jasmin.rdf.ac.uk to the LOTUS queue on the jasmin@CEDA system. You'll need to be on the jasmin sci nodes to do this.

Please get back to us if you need to discuss this further.

Thanks
Andy

[mvguarino]

Hi Andy,

What a horrible news you gave me.
Would it be possible to run a batch job on ARCHER instead? (I tried, but again the qsub command is not found)

Vittoria

[andy]

Hi Vittoria,

Could you explain what you're trying to do? Once we understand we'll be able to advise you better.

Thanks
Andy

[mvguarino]

Hi,

I've got a python script, using IRIS, to process some model data currently on the RDF. The scripts does some re-gridding, calculates means etc.
It takes about 1 minute per file to run, and I have got more than 300 monthly files (the number will increase).
As it is too slow, I was thinking to run the script on multiple cores.

Vittoria

[andy]

Hi Vittoria,

As we don't have a batch system on jasmin.rdf.ac.uk I would recommend multiple logins in this instance. If you had four concurrent sessions running in four different windows running your data through iris then you'd get through your data in 300 / 4 = 75 minutes.

Andy