Opened 8 years ago
Closed 8 years ago
#1057 closed task (fixed)
Data request - Ensemble start data
Reported by: | abarrett | Owned by: | willie |
---|---|---|---|
Component: | Data | Keywords: | |
Cc: | Platform: | HECToR | |
UM Version: | <select version> |
Description
Hi,
I require quite a large volume of data to run multiple ensemble (MOGREPS-R) jobs on HECToR (as part of the PRESTO project). I appreciate that this transfer may take some time, and would be happy for it to be incremental (i.e. all files for 20120411 first, followed by other days). The files I need and my understanding of where they can be found is below. I would also be interested to know if any forecast/analysis data from the 2.2km ensemble is available on the archive.
Many Thanks,
Andrew
The files I need are:
NAE start dumps
20120411 18Z
20120821 18Z
20120825 06Z
20120827 06Z
20120909 06Z
20121228 18Z
MOGREPS-R analysis files and perturbation files
20120411 18Z
20120821 18Z
20120825 06Z
20120827 06Z
20120909 06Z
20121228 18Z
Ensemble fields are in:
moose:/opfc/atm/mogreps-g/rerun/YYYYMM.file
moose:/opfc/atm/mogreps-r/rerun/YYYYMM.file
We need the analysis files in the mogreps-r path:
E.g. 20110722_qwqy06.T+0.18km 20110722_qwqy18.T+0.18km
(All files containing 'T+0' in the filename)
And all the perturbations files
E.g. 20110722_perts.qwey06.oper??.pp1 where ?? Goes from 00 to 23
members
(All files containing 'perts' in the filename)
Also in the mogreps-g path we need the boundary files:
E.g. 20110722_qweg00.oper??.FRAMES.EY.tar.gz
(at the corresponding times to above; it may be necessary to be 6 hours earlier)
Change History (8)
comment:1 Changed 8 years ago by willie
- Owner changed from um_support to willie
- Platform changed from <select platform> to HECToR
- Status changed from new to accepted
comment:2 Changed 8 years ago by abarrett
Hi Willie,
Thanks for this, I have now copied the data from your directory, so you can remove it now.
I don't think that the missing half is a problem, although I asked for the wrong boundary file time (should be 6 hours before analysis time) and as a result the missing half of the perturbations and boundary files are completely out of phase (perts are 01-11 and lbcs are 00,12-22). I assume the missing half is to do with changes to the operational setup, and that the other half of the files exist for 6 hours earlier and later.
To complete the set of ensemble members, would it be possible to get data for:
boundary files - 20120411 12Z
perturbations - 20120412 00Z
NAE + MOGREPS-R analysis - 20120412 00Z
Don't worry about the other days just yet - I'll check that my model setup works first.
Many Thanks
Andrew
comment:3 Changed 8 years ago by willie
Hi Andrew,
The data to complete the set is now on HECToR in /work/n02/n02/wmcginty/data_xfer. Please copy it as soon as possible.
Regards,
Willie
comment:4 Changed 8 years ago by abarrett
Thanks Willie, I've copied this data across now.
comment:5 Changed 8 years ago by abarrett
Hi Willie,
When you can, could you please copy the following data for me:
MOGREPS-R analysis files and perturbation files:
20120821 18Z & 20120822 00Z
20120825 06Z & 12Z
20120827 06Z & 12Z
20120909 06Z & 12Z
20121228 12Z & 18Z
And MOGREPS-R boundary files for 6 hours earlier than all the above times.
Thanks
Andrew
comment:6 Changed 8 years ago by willie
Hi Andrew,
You data is now ready on HECToR in /work/n02/n02/wmcginty/abarrett. It is 35GB. I used a simple script, so the boundary files for 20120822 00Z are in their own directory.
Please copy this data as soon as possible.
Regards,
Willie
comment:7 Changed 8 years ago by abarrett
Thanks Willie,
I have now copied this data across. You can remove the data and close this ticket.
Thanks
Andrew
comment:8 Changed 8 years ago by willie
- Resolution set to fixed
- Status changed from accepted to closed
Hi Andrew
The data for the first day is now on HECToR in /work/n02/n02/wmcginty/data_xfer. It amounts to 7.7 GB. However half of the perturbations and boundary files are missing. The missing bit depends on the time 00, 06, 12, 18. Let me know if this is a problem.
For reference the commands I used are