Opened 6 years ago

Closed 6 years ago

#1057 closed task (fixed)

Data request - Ensemble start data

Reported by: abarrett Owned by: willie
Component: Data Keywords:
Cc: Platform: HECToR
UM Version: <select version>

Description

Hi,

I require quite a large volume of data to run multiple ensemble (MOGREPS-R) jobs on HECToR (as part of the PRESTO project). I appreciate that this transfer may take some time, and would be happy for it to be incremental (i.e. all files for 20120411 first, followed by other days). The files I need and my understanding of where they can be found is below. I would also be interested to know if any forecast/analysis data from the 2.2km ensemble is available on the archive.

Many Thanks,
Andrew

The files I need are:
NAE start dumps
20120411 18Z
20120821 18Z
20120825 06Z
20120827 06Z
20120909 06Z
20121228 18Z

MOGREPS-R analysis files and perturbation files
20120411 18Z
20120821 18Z
20120825 06Z
20120827 06Z
20120909 06Z
20121228 18Z

Ensemble fields are in:
moose:/opfc/atm/mogreps-g/rerun/YYYYMM.file
moose:/opfc/atm/mogreps-r/rerun/YYYYMM.file

We need the analysis files in the mogreps-r path:
E.g. 20110722_qwqy06.T+0.18km 20110722_qwqy18.T+0.18km
(All files containing 'T+0' in the filename)

And all the perturbations files
E.g. 20110722_perts.qwey06.oper??.pp1 where ?? Goes from 00 to 23
members
(All files containing 'perts' in the filename)

Also in the mogreps-g path we need the boundary files:
E.g. 20110722_qweg00.oper??.FRAMES.EY.tar.gz
(at the corresponding times to above; it may be necessary to be 6 hours earlier)

Change History (8)

comment:1 Changed 6 years ago by willie

  • Owner changed from um_support to willie
  • Platform changed from <select platform> to HECToR
  • Status changed from new to accepted

Hi Andrew

The data for the first day is now on HECToR in /work/n02/n02/wmcginty/data_xfer. It amounts to 7.7 GB. However half of the perturbations and boundary files are missing. The missing bit depends on the time 00, 06, 12, 18. Let me know if this is a problem.

For reference the commands I used are

# NAE start dumps and LBC
moo get moose:/opfc/atm/nae/rerun/201204.file/20120411_qwqy18.T+0 .
moo get moose:/opfc/atm/nae/rerun/201204.file/20120411_qwqg18.alabc_my_70lev .


# Ensemble analysis
moo get moose:/opfc/atm/mogreps-r/rerun/201204.file/20120411_qwqy18.T+0* .


# Ensemble perturbation files - may not be complete 00 to 23 for all times
moo get moose:/opfc/atm/mogreps-r/rerun/201204.file/20120411_perts.qwey18.oper??.pp1 .

# Ensemble boundary files - may not be complete 00 to 23
 moo get moose:/opfc/atm/mogreps-g/rerun/201204.file/20120411_qweg18.oper??.FRAMES.EY.gz .

comment:2 Changed 6 years ago by abarrett

Hi Willie,

Thanks for this, I have now copied the data from your directory, so you can remove it now.

I don't think that the missing half is a problem, although I asked for the wrong boundary file time (should be 6 hours before analysis time) and as a result the missing half of the perturbations and boundary files are completely out of phase (perts are 01-11 and lbcs are 00,12-22). I assume the missing half is to do with changes to the operational setup, and that the other half of the files exist for 6 hours earlier and later.

To complete the set of ensemble members, would it be possible to get data for:
boundary files - 20120411 12Z
perturbations - 20120412 00Z
NAE + MOGREPS-R analysis - 20120412 00Z

Don't worry about the other days just yet - I'll check that my model setup works first.

Many Thanks
Andrew

comment:3 Changed 6 years ago by willie

Hi Andrew,

The data to complete the set is now on HECToR in /work/n02/n02/wmcginty/data_xfer. Please copy it as soon as possible.

Regards,

Willie

comment:4 Changed 6 years ago by abarrett

Thanks Willie, I've copied this data across now.

comment:5 Changed 6 years ago by abarrett

Hi Willie,

When you can, could you please copy the following data for me:

MOGREPS-R analysis files and perturbation files:
20120821 18Z & 20120822 00Z
20120825 06Z & 12Z
20120827 06Z & 12Z
20120909 06Z & 12Z
20121228 12Z & 18Z

And MOGREPS-R boundary files for 6 hours earlier than all the above times.

Thanks
Andrew

comment:6 Changed 6 years ago by willie

Hi Andrew,

You data is now ready on HECToR in /work/n02/n02/wmcginty/abarrett. It is 35GB. I used a simple script, so the boundary files for 20120822 00Z are in their own directory.

Please copy this data as soon as possible.

Regards,

Willie

comment:7 Changed 6 years ago by abarrett

Thanks Willie,

I have now copied this data across. You can remove the data and close this ticket.

Thanks
Andrew

comment:8 Changed 6 years ago by willie

  • Resolution set to fixed
  • Status changed from accepted to closed
Note: See TracTickets for help on using tickets.