Opened 3 years ago

Closed 3 years ago

#2360 closed help (fixed)

Cycling nesting suite fails after two runs

Reported by: tstein Owned by: um_support
Component: UM Model Keywords:
Cc: Platform:
UM Version: <select version>



I want to run the Nesting Suite as 36-hour forecasts for 30 separate days (suite u-ao745).
It manages to run the first two days perfectly, but for the third day I get the following error:

[job-submit cmd] cylc jobs-submit — —user=thmstein —remote-mode — '$HOME/cylc-run/u-ao745/log/job' 20161102T1800Z/glm_um_recon1/01
[job-submit ret_code] 38
[job-submit out] 2018-01-10T17:25:28Z|20161102T1800Z/glm_um_recon1/01|38|None
(thmstein@…) 2018-01-10T17:25:28Z [STDERR] qsub: would exceed queue generic's per-user limit

The CRUN length for my suite is 3 hours, so it probably submits 12 jobs per forecast day.
I also have "Build new executable" switched on, so that's a task for each forecast day - I probably do not need this?
I also have "Create new ancillaries", but I believe that is necessary for each forecast day, as it will be nested inside a different global analysis run.

Is there a set up that I should consider that would allow my entire run to succeed without hitting my user limit for submitting jobs to the queue?


Change History (3)

comment:1 Changed 3 years ago by grenville

Cylc can do this for you see

add to suite.rc


[[ queues]]


limit = 3 (for example)


comment:2 Changed 3 years ago by grenville


I forgot to add a members = entry —- that maybe tricky for the nesting suite

Alternatively, you could just set the default

[[ queues]]


limit = 2 (for example)

comment:3 Changed 3 years ago by willie

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.