job limit

[simon.tett]

Hi,

I am doing data conversion of field files to netcdf by submitting jobs to the serial Q. It has all been running smoothly till now but I now have an ensemble of jobs.. So lots of conversion jobs. I get an error:

qsserver: Sat Aug 13 08:43:06 BST 2016: xmvpaa.ps1915son ARCHIVE PPNOCHART
qsub: would exceed complex's per-user limit
Generated Conversion Script /work/n02/n02/stett2/tmp/tmp.mom5.5772/xmvpaa.ps1915son.ff_arch_31308.txt
qscasedisp: return code after calling qsarcher_convnc RCARC=38

Two of my jobs failed as a consequence.. Can my limit on the number of jobs be doubled?

thanks

Simon

[ros]

Hi Simon,

The number of jobs that you can submit to each queue is a hard-limit set by ARCHER and is not changeable. The maximum jobs you can submit to the serial queue is 12.

Regards,
Ros.

[simon.tett]

A sort of update to this. I think what happened was the serial Q got blocked by a long lasting job. So all my jobs piled up and then the model crashed. This per say is not a bad outcome — if the model just kept going it would fill up disk space and crash in a more uncontrolled way. Maybe it illustrates a problem with my approach of using jobs to convert data rather than ssh. However, ssh is very unreliable and I found that failed very frequently…

So does the serial Q only allow one job to run at a time?

Simon

[ros]

Hi Simon,

You can submit a maximum of 12 jobs to the serial queue per user only 6 of which can be running at any time.

A full list of limits is available on the archer website:
​http://www.archer.ac.uk/documentation/user-guide/batch.php#sec-5.8

Cheers,
Ros.