Changes between Version 4 and Version 5 of CDDS


Ignore:
Timestamp:
26/09/19 12:11:34 (11 months ago)
Author:
grenville
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • CDDS

    v4 v5  
    1 == CMIP6 data CMOR'isation - How to run the CDDS work flow on JASMIN == 
     1= CMIP6 data CMOR'isation - How to run the CDDS work flow on JASMIN = 
    22 
    3 === 1. JASMIN  GWS access === 
     3== 1. JASMIN  GWS access == 
    44 
    55You will need access to the cmip6_prep Group Workspace. Apply here: 
     
    77https://accounts.jasmin.ac.uk/services/group_workspaces/cmip6_prep/ 
    88 
    9 === 2. MOSRS access === 
     9== 2. MOSRS access == 
    1010 
    1111You will need MOSRS access from JASMIN, see 
    1212https://code.metoffice.gov.uk/trac/home/wiki/AuthenticationCaching 
    1313 
    14 === 3. Where to run === 
     14== 3. Where to run == 
    1515The CDDS work flow comprises several phases 
    1616A. preparation 
     
    2020Phase A runs interactively, is light on computational resource and can be run on jasmin-cylc. Phase B is computationally intensive, runs on LOTUS, and monitored from jasmin-cylc. Phase C is potentially computationally intensive and should not be run on jasmin-cylc - one of the jasmin sci machines will be appropriate. 
    2121 
    22 === 4. Model  Data === 
     22== 4. Model  Data == 
    2323CDDS expects data to be in a JASMIN group workspace. CDDS supports two data directory structures: 
    24241. data by stream - data from MASS will be structured by stream (ap4, ap5, apm...) 
    25252. data bu cycle - data from ARCHER or NEXCS will be structured by cylc cycle (18500101T0000Z, 18500111T0000Z, 18500401T0000Z, ...) 
    2626 
     27== 5. Running CDDS == 
     28The CDDS work flow is driven by the ''json request file'' - which holds information about the MIP, the experiment, streams to be processed, start and end dates, the source model suite id, and more.  
     29 
     30Where possible you should generate the json request file - you will need access to Met Office internal systems to do that. However, it is not difficult to modify an existing request file for your use - you will need knowledge of the MIP and the experiment for this. 
     31 
     32=== Ocean data preparation === 
     33 
     34NEMO output needs to be pre-processed to remove halos. CMS have developed a Rose suite to automate halo removal - the suite is available here (??). We suggest creating a fully halo-removed data set prior to running CDDS. 
     35 
     36 
     37 
     38 
     39 
     40 
     41 
     42 
     43 
    2744  
    2845