Changes between Version 7 and Version 8 of CDDS


Ignore:
Timestamp:
26/09/19 14:26:56 (7 months ago)
Author:
grenville
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • CDDS

    v7 v8  
    2020Phase A runs interactively, is light on computational resource and can be run on jasmin-cylc. Phase B is computationally intensive, runs on LOTUS, and monitored from jasmin-cylc. Phase C is potentially computationally intensive and should not be run on jasmin-cylc - one of the jasmin sci machines will be appropriate. 
    2121 
     22Note: CDDS sources its own bespoke environment. To avoid potential conflicts, your environment should be as simple as possible - you may need to alter it to ensire 
     23 
    2224== 4. Model  Data == 
    2325CDDS expects data to be in a JASMIN group workspace. CDDS supports two data directory structures: 
     
    3436NEMO output needs to be pre-processed to remove halos. CMS have developed a Rose suite to automate halo removal - the suite is available here (??). We suggest creating a fully halo-removed data set prior to running CDDS. 
    3537 
     38=== Example conversion process === 
     39 
    3640There follows an example work flow, illustrative of the CDDS process. 
    3741The MIP is AerChemMIP and the experiment is piClim-NTCF (note, case sensitive) - (see https://rawgit.com/WCRP-CMIP/CMIP6_CVs/master/src/CMIP6_experiment_id.html for information about individual experiments.) 
    3842 
    39 Create a directory for the experiment (AerchemMIP-piClim-NTCF in this case). 
    40 Get the conversion process orchestration script {{{cdds_workflow_for_user.sh}}} (from where?) 
     43Create a directory for the experiment (I chose AerchemMIP-piClim-NTCF in this case). 
     44Copy (git?) the conversion process orchestration script {{{cdds_workflow_for_user.sh}}} (from where?) to this directory 
     45 
     46{{{ 
     47cd AerchemMIP-piClim-NTC 
     48cp cdds_workflow_for_user.sh AerchemMIP-piClim-NTC/cdds_workflow_for_user.sh 
     49}}}  
     50 
    4151 
    4252Edit {{{cdds_workflow_for_user.sh}}} to set {{{CDDS_DIR}}} and {{{REQUEST_JSON}}} 
    4353{{{ 
    44 export CDDS_DIR="/group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF" 
     54export CDDS_DIR="<full-path>/AerchemMIP-piClim-NTCF" 
    4555REQUEST_JSON=aerchemmip-req.json 
    4656}}} 
    4757 
     58Get a copy of {{{CMIP6.cfg}}} from {{{somewhere central}}} and lodge it in {{{CDDS_DIR}}} under a new directory as follows 
     59{{{ 
     60mkdir -p CMIP6/v1.0.5/general 
     61cp <somewhere central>/CMIP6.cfg CMIP6/v1.0.5/general/CMIP6.cfg 
     62}}} 
    4863 
     64Edit your newly copied {{{CMIP6.cfg}}} to set {{{dataroot}}} and {{{procroot}}} - in this case the edits are 
     65{{{ 
     66dataroot = /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_data 
     67procroot = /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_proc 
     68}}} 
     69 
     70This just says point to {{{cdds_data}}} and {{{cdds_proc}}}, which will be created later in {{{CDDS_DIR}}}. 
    4971 
    5072