Changes between Version 25 and Version 26 of CDDS
- Timestamp:
- 02/10/19 13:30:29 (16 months ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
CDDS
v25 v26 42 42 43 43 44 1. Create a top-level directory for the experiment - this will later become synonymous with $CDDS_DIR (I chose to name it `AerchemMIP-piClim-NTCF` in this case).44 1. Under /group_wrokspaces, create a top-level directory for the experiment - this will later become synonymous with $CDDS_DIR (I chose to name it `AerChemMIP-piClim-NTCF` in this case). 45 45 46 2. Change directory to `Aer chemMIP-piClim-NTCF` - all work should take place here46 2. Change directory to `AerChemMIP-piClim-NTCF` - all work should take place here 47 47 {{{ 48 cd Aer chemMIP-piClim-NTC48 cd AerChemMIP-piClim-NTCF 49 49 }}} 50 50 … … 58 58 4. Edit {{{cdds_workflow_for_user.sh}}} to set the environment variables {{{CDDS_DIR}}} and {{{REQUEST_JSON}}} 59 59 {{{ 60 export CDDS_DIR="<full-path>/Aer chemMIP-piClim-NTCF"60 export CDDS_DIR="<full-path>/AerChemMIP-piClim-NTCF" 61 61 REQUEST_JSON=AerChemMIP-piClim-NTCF-req.json 62 62 }}} … … 70 70 '''Note: `/home/users/glister/CDDS` is for testing only -- to be moved centrally''' 71 71 72 6. Edit your newly copied {{{CMIP6.cfg}}} to set {{{dataroot}}} and {{{procroot}}} - in this particular example the edits are72 6. Edit your newly copied {{{CMIP6.cfg}}} to set {{{dataroot}}} and {{{procroot}}}. These should be under {{{$CDDS_DIR}}} set in 4. above - in this particular example the edits are 73 73 {{{ 74 dataroot = /group_workspaces/jasmin4/ncas_cms/glister/Aer chemMIP-piClim-NTCF/cdds_data75 procroot = /group_workspaces/jasmin4/ncas_cms/glister/Aer chemMIP-piClim-NTCF/cdds_proc74 dataroot = /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data 75 procroot = /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_proc 76 76 }}} 77 77 This just says point {{{dataroot}}} and {{{procroot}}} to {{{cdds_data}}} and {{{cdds_proc}}} (respectively), which will be created later in {{{CDDS_DIR}}}. Note: you '''can not''' use the environment variable `$CDDS_DIR` in {{{CMIP6.cfg}}}. 78 78 79 7. Create the json request file -- here's the one used in our example. Much of the information listed here is taken directly from the rose-suite.info file for the UM model suite that generated the data (u-bh543 for our example)79 7. Create the json request file, naming the same as {{{$REQUEST_JSON}}} set in 4. -- here's the one used in our example. Much of the information listed here is taken directly from the rose-suite.info file for the UM model suite that generated the data (u-bh543 for our example) 80 80 {{{ 81 81 { … … 123 123 `cdds-data` will hold spaces for input and output data 124 124 {{{ 125 ls /group_workspaces/jasmin4/ncas_cms/glister/Aer chemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly125 ls /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly 126 126 input/ output/ 127 127 }}} … … 129 129 `cdds_proc` will contain various configuration files and logging output 130 130 {{{ 131 ls /group_workspaces/jasmin4/ncas_cms/glister/Aer chemMIP-piClim-NTCF/cdds_proc/CMIP6/AerChemMIP/UKESM1-0-LL_piClim-NTCF_r1i1p1f2/round-1-monthly131 ls /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_proc/CMIP6/AerChemMIP/UKESM1-0-LL_piClim-NTCF_r1i1p1f2/round-1-monthly 132 132 archive/ configure/ convert/ extract/ prepare/ qualitycheck/ 133 133 }}} … … 143 143 9. Tell CDDS where the input data resides by specifying its location (through soft links in this case) in the cdds_data directory. In our example, the raw data is in the aerchemmip group workspace 144 144 {{{ 145 cd /group_workspaces/jasmin4/ncas_cms/glister/Aer chemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/input145 cd /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/input 146 146 ln -s /gws/nopw/j04/aerchemmip_vol1/data/u-bh543_4archive u-bh543 147 147 }}} … … 153 153 11. Converted data will be written to the `output` directory in cdds_data 154 154 {{{ 155 ls /group_workspaces/jasmin4/ncas_cms/glister/Aer chemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/output155 ls /group_workspaces/jasmin4/ncas_cms/glister/AerChemMIP-piClim-NTCF/cdds_data/CMIP6/AerChemMIP/UKESM1-0-LL/piClim-NTCF/r1i1p1f2/round-1-monthly/output 156 156 ap4/ ap4_concat/ ap4_mip_convert/ ap5/ ap5_concat/ ap5_mip_convert/ 157 157 }}}