Error in reconfiguration

[laurahb]

Hi,
I've made a copy of an existing suite and tried to run it (turning on build and run). It's successfully completing the build stage but then failing in reconfiguration. However, I'm not sure why, and it's not obvious from the error log file.
The suite id is u-ba861 and the error log is here:
​http://puma.nerc.ac.uk/rose-bush/view/laurahb/u-ba861?&no_fuzzy_time=0&path=log/job/19900901T0000Z/recon/01/job.err

Any idea what's wrong?

[willie]

Hi Laura,

The start file

/work/n02/n02/lbaker/cylc-run/u-ba776/share/data/History_Data/last_starts/ba776a.da19900901_00

has NaNs? in it. You can see this by running mule-cumf to compare the file with itself. So you need to look at how this was generated.

A shortened mule-cumf output is below

mule-cumf /work/n02/n02/lbaker/cylc-run/u-ba776/share/data/History_Data/last_starts/ba776a.da19900901_00 /work/n02/n02/lbaker/cylc-run/u-ba776/share/data/History_Data/last_starts/ba776a.da19900901_00
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
* (CUMF-II) Module Information *
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
mule       : /work/y07/y07/umshared/lib/python2.7/mule/__init__.py (version 2017.08.1)
um_utils   : /work/y07/y07/umshared/lib/python2.7/um_utils/__init__.py (version 2017.08.1)
um_packing : /work/y07/y07/umshared/lib/python2.7/um_packing/__init__.py (version 2017.08.1) (packing lib from SHUMlib: 2017101)


/work/y07/y07/umshared/lib/python2.7/um_utils/cumf.py:295: RuntimeWarning: invalid value encountered in subtract
  diff = np.abs(data1 - data2)
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
* CUMF-II Comparison Report *
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

File 1: /work/n02/n02/lbaker/cylc-run/u-ba776/share/data/History_Data/last_starts/ba776a.da19900901_00
File 2: /work/n02/n02/lbaker/cylc-run/u-ba776/share/data/History_Data/last_starts/ba776a.da19900901_00
Files DO NOT compare
  * 0 differences in fixed_length_header (with 7 ignored indices)
  * 707 field differences, of which 707 are in data

Compared 8497/8497 fields, with 7790 matches

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
* Field 188/8497 - THETA AFTER TIMESTEP *
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
Lookup compares, data DOES NOT compare

:
:

Regards
Willie

[grenville]

Laura

You have specified AINITIAL as /work/n02/n02/lbaker/cylc-run/u-ba776/share/data/History_Data/last_starts/ba776a.da19900901_00 and astart to be the same file - this means the reconfiguration has written to its own input file. It looks like ba776a.da19900901_00 is damaged beyond repair.

Grenville