wiki:UM/GettingInitialData

Version 1 (modified by willie, 4 years ago) (diff)

Getting Initial Data

Start dumps, LBC files and ensemble data can be obtained from the Met Office MOOSE database. This covers the latest five years.

Start dumps from earlier periods can be constructed as GRIB files from ECMWF data.

Getting data from the Met Office

The start dumps are now stored in MOOSE, which can be accessed via MONSooN.

To get data for 28/Sep/2011 we would type,

moo get moose:/opfc/atm/global/rerun/201109.file/20110928_qwqg00.T+0 .

(Note the dot). This takes about 15 to 20 minutes.

To find out whether the data exists in moose:

moo ls moose:/opfc/atm/global/rerun/201109.file

Generally we prefer to get the output from the global runs - these have "qwqg" in the title; otherwise we get the global update - these have "qwqu" in the file name.

Older files are stored in a packed archive format - these have the extension ".pax". These usually contain several dumps and have names like,

coprr.udQU06.20060721.pax

where the "ud" denotes "unified model dump" and QU06 denotes global update output at 06Z. These have to be unpacked and the files relabelled. There is a script to do this in

 
#!/bin/ksh
# i will be like coprr.udQU06.20060725.pax
for i in *.pax
do
print $i
dat=${i%.*}                   # take .pax off the end
datestring=${dat##*.}        # remove bit to left of the rightmost dot
pax -r -f $i
cd opdaily/datawgl
for j in *
do
mv $j $TMPDIR/${datestring}_$j
done
cd -
done

This assumes a list of pax files and unpacks, relabels and stores the results in $TMPDIR.

Getting data from ECMWF

W. McGinty, 15 Oct 2015