Global Job Failing in Reconfiguration

[LSaffin]

I'm trying to run a global model (job xjjhx) using automatic resubmission and getting the message,

/projects/diamet/lsaffi/xjjhx/bin/qsexecute: Error in dump reconfiguration - see OUTPUT

in the .leave file (/home/lsaffi/output/xjjhx000.xjjhx.d14260.t151358.leave on monsoon).

The job uses PV tracers edits under,

fcm:um_br/dev/LSaffin/vn7.3_PV_tracers_budget/src

with stash modified by the file,
/home/sws04jc/28trancil7.3,
as well as the fix
/home/willie/userSTASH/STASH_7.3_7.5.

Something in there has caused an error in the umui when trying to add new diagnostics which may be related.

Unexpected STASH option code st_mask_n(8)=3. Model A. Section 0

I did get this job to run as a regular job but adding in the automatic resubmission options stopped it working.

Leo

[annette]

Hi Leo,

Sorry for the delay in responding to this.

The error when trying to load a diagnostic in STASH is not what is causing the job to fail. It's a known bug with the UMUI and user stash-master files. See #1041 for how to get around it.

The .leave file is pretty unhelpful in your case, but if you go to your job output directory (defined as $DATAW in the UMUI) you can see the reconfiguration output files from all pes. Opening a non-empty file, (eg, xjjhx.fort6.rcfa.pe1) shows the error message:

 *****************************************************************************
 ERROR!!! in reconfiguration in routine Rcf_Set_Data_Source
 Error Code:-  30
 Error Message:-  Section  0 Item  321  : Required field is not in input dump!
 Error generated from processor  1
 *****************************************************************************

This field comes from the user stash file /home/sws04jc/28trancil7.3. And it is set to initialise from the start file in the UMUI panel "Atmosphere → STASH → Initialisation of User prognostics"

Hopefully this gives you enough information to fix your problem, but if not let me know.

Regards,
Annette

[annette]

I should add that through the "User prognostics" panel it is possible to set the field to a constant or read in from a different file. I don't think any of the fields from /home/sws04jc/28trancil7.3 are in the start file.

Annette

[LSaffin]

That was the issue, thanks. I needed to set the fields to initialise from the start dump in the resubmit runs but not the initial run.