Changes between Version 1 and Version 2 of UM/Configurations/HectorHadgem3aoR40


Ignore:
Timestamp:
26/04/13 17:13:00 (6 years ago)
Author:
annette
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • UM/Configurations/HectorHadgem3aoR40

    v1 v2  
    2626   This is a directory on HECToR, typically /home/n02/n02/<userid> 
    2727 
    28 3. ''Input/Output Control and Resources -> Time Convention and SCRIPT Environment Variables'' [[br]] 
     283. ''!Input/Output Control and Resources -> Time Convention and SCRIPT Environment Variables'' [[br]] 
    2929 
    3030   Check that the settings for $DATAW and $DATAM are as you require. 
     
    5353 
    5454A small number of changes can be made through the UMUI - in particular the  model start date, run length and resubmission length are applied to all submodels. The number of processors and domain decompositions for each submodel are also controlled through the UMUI under ''User Information and Submit Method -> General details''. 
    55 ' 
     55 
    5656Note that unlike the UM atmosphere model the ocean model '''must be recompiled''' to alter the decomposition of NEMO or CICE. 
    5757 
     
    9999A summary of the changes made to the Met Office job to run on the XE6 system. See also the list of branches below. 
    100100 
    101     HECToR details: 
    102     User and machine details including username, tic-code, machine name and job submission information ('qsub' for PBS pro) 
    103     Atmos to ocean pe decomposition: 
    104     This was modified to to 8x12 for the atmosphere, 4x8 for NEMO and 32x1 for CICE. NEMO and CICE are compiled into a single executable and run sequentially. This adds up tp 160 cores (5 nodes) including 1 node (32 cores) for OASIS. This was found to be the best decomposition of those tested. 
    105     Job directories: 
    106     HECToR output directory set to $DATADIR/um/$RUNID and puma extract directory set to /work/n02/n02/username/um. 
    107     Path to local umui files: 
    108     /home/umui/hadgem3/vn7.6/HG3AO40/. This contains hand edits (hand_edits/), compile overrides (overrides/), user STASH master files (preSTASHmaster/), coupling macros (macros/), NEMO configuration files (nemo_cfg/) and CICE configuration files (cice_cfg/). 
    109     Extra hand-edits for puma: 
    110     Currently a hand-edit is required for submission of the coupled model to HECToR (vn7.5_oasis_nproc.ed) and for archiving (archiving_7.6). 
    111     Location of input data files on HECToR: 
    112     $UMDIR/vn7.6/HG3AO40. This contains start dumps, ancillary and forcing files plus NEMO and CICE control namelists (nemo_ctl/ and cice_ctl/). 
    113     Byte swap CICE binary restart file: 
    114     iced_start_abwORCA1_sep_swapped.bin 
    115     Location of the OASIS build on HECToR: 
    116     /work/n02/n02/hum/oasis/oasis3_2-5/prism/crayxe6_cce. 
    117     Coupling macro: 
    118     Point to version for HECToR (uses &END rather than / in namelists): cpl_macro_hadgem3_3hr. 
    119     FCM settings for puma: 
    120     Fill in "container file name and location", "bindings location" and "subversion URL" for puma. 
    121     Puma versions of branches: 
    122     Replace Met Office versions of branches with puma equivalents (see branches on puma below.) 
    123     Include extra atmos branches: 
    124     For running on HECToR fcm:um_br/pkg/Config/VN7.6_ncas/src and fcm:um_br/dev/jeff/VN7.6_hector_monsoon_archiving/src. 
    125     Include extra NEMO branches: 
    126     These contain fixes for HECToR. fcm:nemo_br/dev/annette/VN3.0_fixes_to_nemo_trunk/NEMO and fcm:nemo_br/dev/annette/VN3.0_coupled_fixes/NEMO 
    127     Include extra CICE branches: 
    128     Fix for HECToR. fcm:cice_br/dev/annette/VN4.1_dbl_notation_fix/cice 
     101* '''HECToR details''': [[br]] 
     102  User and machine details including username, tic-code, machine name and job submission information ('qsub' for PBS pro) 
     103* '''Atmos to ocean pe decomposition''': [[br]] 
     104  This was modified to to 8x12 for the atmosphere, 4x8 for NEMO and 32x1 for CICE. NEMO and CICE are compiled into a single executable and run sequentially. This adds up tp 160 cores (5 nodes) including 1 node (32 cores) for OASIS. This was found to be the best decomposition of those tested. 
     105* '''Job directories''': [[br]] 
     106  HECToR output directory set to $DATADIR/um/$RUNID and puma extract directory set to /work/n02/n02/username/um. 
     107* '''Path to local umui files''': [[br]] 
     108  /home/umui/hadgem3/vn7.6/HG3AO40/. This contains hand edits (hand_edits/), compile overrides (overrides/), user STASH master files (preSTASHmaster/), coupling macros (macros/), NEMO configuration files (nemo_cfg/) and CICE configuration files (cice_cfg/). 
     109* '''Extra hand-edits for puma''': [[br]] 
     110  Currently a hand-edit is required for submission of the coupled model to HECToR (vn7.5_oasis_nproc.ed) and for archiving (archiving_7.6). 
     111* '''Location of input data files on HECToR''': [[br]] 
     112  $UMDIR/vn7.6/HG3AO40. This contains start dumps, ancillary and forcing files plus NEMO and CICE control namelists (nemo_ctl/ and cice_ctl/). 
     113* '''Byte swap CICE binary restart file''': [[br]] 
     114  iced_start_abwORCA1_sep_swapped.bin 
     115* '''Location of the OASIS build on HECToR''': [[br]] 
     116  /work/n02/n02/hum/oasis/oasis3_2-5/prism/crayxe6_cce. 
     117* '''Coupling macro''': [[br]] 
     118  Point to version for HECToR (uses &END rather than / in namelists): cpl_macro_hadgem3_3hr. 
     119* '''FCM settings for puma''': [[br]]] 
     120  Fill in "container file name and location", "bindings location" and "subversion URL" for puma. 
     121* '''Puma versions of branches''': [[br]] 
     122  Replace Met Office versions of branches with puma equivalents (see branches on puma below.) 
     123* '''Include extra atmos branches''': [[br]] 
     124  For running on HECToR fcm:um_br/pkg/Config/VN7.6_ncas/src and fcm:um_br/dev/jeff/VN7.6_hector_monsoon_archiving/src. 
     125* '''Include extra NEMO branches''': [[br]] 
     126  These contain fixes for HECToR. fcm:nemo_br/dev/annette/VN3.0_fixes_to_nemo_trunk/NEMO and fcm:nemo_br/dev/annette/VN3.0_coupled_fixes/NEMO 
     127* '''Include extra CICE branches''': [[br]] 
     128  Fix for HECToR. fcm:cice_br/dev/annette/VN4.1_dbl_notation_fix/cice 
     129* '''Compile options for NEMO and CICE''': [[br]] 
     130  Configuration files to extract NEMO v3.0 and CICE v4.1 from puma repository and set compiler flags for pathscale on HECToR: nemo_XE6_cce_3.0_base.cfg (NEMO) and cice4.1_base_XE6_cce.cfg (CICE). 
     131* '''Linking to OASIS libraries on HECToR''': [[br]] 
     132  Update NEMO library flags set in the UMUI for HECToR (remove netcdf and IBM-specific options). Atmosphere options are specified in two compile override files: oasis_file_hector_cce_7.6 and oasis_mach_hector_cce_7.6. 
     133* '''Tidying up''':  
     134  IBM-specific environment variables were removed, FCM output was reduced from '3' to '1', output prints were reduced from "operational" to "normal", outputting of basis files was turned off, and pe output files were set to be deleted on successful completion. Switched off user-script releases. 
    129135 
    130     Compile options for NEMO and CICE: Configuration files to extract NEMO v3.0 and CICE v4.1 from puma repository and set compiler flags for pathscale on HECToR: nemo_XE6_cce_3.0_base.cfg (NEMO) and cice4.1_base_XE6_cce.cfg (CICE). 
    131  
    132     Linking to OASIS libraries on HECToR: Update NEMO library flags set in the UMUI for HECToR (remove netcdf and IBM-specific options). Atmosphere options are specified in two compile override files: oasis_file_hector_cce_7.6 and oasis_mach_hector_cce_7.6. 
    133  
    134     Tidying up: IBM-specific environment variables were removed, FCM output was reduced from '3' to '1', output prints were reduced from "operational" to "normal", outputting of basis files was turned off, and pe output files were set to be deleted on successful completion. 
    135  
    136     Switch off user-script releases 
    137  
    138   
    139 Branches on puma 
     136=== Branches on puma === 
    140137 
    141138A list of the branches included in this job and the equivalents on puma. 
    142  
     139{{{ 
    143140UM  
    144141Met Office branch                                      Rev     Puma branch                                                       Rev 
     
    185182fcm:cice_br/dev/hadci/VN4.1_no_vert_check/cice         317     fcm:cice_br/dev/charris/VN4.1_no_vert_check_ukmo/cice             1314 
    186183                                                               fcm:cice_br/dev/annette/VN4.1_dbl_notation_fix/cice               1803 
    187  
     184}}}