Changes between Version 25 and Version 26 of CDDS


Ignore:
Timestamp:
02/10/19 13:30:29 (9 months ago)
Author:
simon
Comment:

—

Legend:

Unmodified
Added
Removed
Modified

  • CDDS

    v25 v26  
    4242 
    4343 
    44 1. Create a top-level directory for the experiment - this will later become synonymous with $CDDS_DIR (I chose to name it `AerchemMIP-piClim-NTCF` in this case). 
     441. Under /group_wrokspaces, create a top-level directory for the experiment - this will later become synonymous with $CDDS_DIR (I chose to name it `AerChemMIP-piClim-NTCF` in this case). 
    4545 
    46 2. Change directory to `AerchemMIP-piClim-NTCF` - all work should take place here 
     462. Change directory to `AerChemMIP-piClim-NTCF` - all work should take place here 
    4747{{{ 
    48 cd AerchemMIP-piClim-NTC 
     48cd AerChemMIP-piClim-NTCF 
    4949}}} 
    5050 
    … …  
    58584. Edit {{{cdds_workflow_for_user.sh}}} to set the environment variables {{{CDDS_DIR}}} and {{{REQUEST_JSON}}} 
    5959{{{ 
    60 export CDDS_DIR="<full-path>/AerchemMIP-piClim-NTCF" 
     60export CDDS_DIR="<full-path>/AerChemMIP-piClim-NTCF" 
    6161REQUEST_JSON=AerChemMIP-piClim-NTCF-req.json 
    6262}}} 
    … …  
    7070'''Note: `/home/users/glister/CDDS` is for testing only -- to be moved centrally''' 
    7171 
    72 6. Edit your newly copied {{{CMIP6.cfg}}} to set {{{dataroot}}} and {{{procroot}}} - in this particular example the edits are  
     726. Edit your newly copied {{{CMIP6.cfg}}} to set {{{dataroot}}} and {{{procroot}}}. These should be under {{{$CDDS_DIR}}} set in 4. above - in this particular example the edits are  
    7373{{{ 
    74 dataroot = /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_data 
    75 procroot = /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_proc 
     74dataroot = /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data 
     75procroot = /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_proc 
    7676}}}  
    7777This just says point {{{dataroot}}} and {{{procroot}}} to {{{cdds_data}}} and {{{cdds_proc}}} (respectively), which will be created later in {{{CDDS_DIR}}}. Note: you '''can not''' use the environment variable `$CDDS_DIR` in {{{CMIP6.cfg}}}. 
    7878 
    79 7. Create the json request file -- here's the one used in our example. Much of the information listed here is taken directly from the rose-suite.info file for the UM model suite that generated the data (u-bh543 for our example) 
     797. Create the json request file, naming the same as {{{$REQUEST_JSON}}} set in 4. -- here's the one used in our example. Much of the information listed here is taken directly from the rose-suite.info file for the UM model suite that generated the data (u-bh543 for our example) 
    8080{{{ 
    8181{ 
    … …  
    123123`cdds-data` will hold spaces for input and output data 
    124124{{{ 
    125 ls /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly 
     125ls /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly 
    126126input/  output/ 
    127127}}} 
    … …  
    129129`cdds_proc` will contain various configuration files and logging output 
    130130{{{ 
    131 ls /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_proc/CMIP6/AerChemMIP/UKESM1-0-LL_piClim-NTCF_r1i1p1f2/round-1-monthly 
     131ls /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_proc/CMIP6/AerChemMIP/UKESM1-0-LL_piClim-NTCF_r1i1p1f2/round-1-monthly 
    132132archive/  configure/  convert/  extract/  prepare/  qualitycheck/ 
    133133}}} 
    … …  
    1431439. Tell CDDS where the input data resides by specifying its location (through soft links in this case) in the cdds_data directory. In our example, the raw data is in the aerchemmip group workspace 
    144144{{{ 
    145 cd /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/input 
     145cd /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/input 
    146146ln -s /gws/nopw/j04/aerchemmip_vol1/data/u-bh543_4archive u-bh543 
    147147}}} 
    … …  
    15315311. Converted data will be written to the `output` directory in cdds_data 
    154154{{{ 
    155 ls /group_workspaces/jasmin4/ncas_cms/glister/AerchemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/output 
     155ls /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/output 
    156156ap4/  ap4_concat/  ap4_mip_convert/  ap5/  ap5_concat/  ap5_mip_convert/ 
    157157}}}