74 | | If your normal module set up is with the gnu or pgi programming environments, then an attempt to load openifs_cce/0.0.2 will fail, and it will also fail unless you have the Cray cce1/8.1.8 compiler loaded. Use '''module swap''' to ensure an appropriate starting module configuration. |
| 74 | If your normal environment is not set up with the cray programming environment, then an attempt to load openifs_cce/0.0.2 will fail, and it will also fail unless you have the Cray cce1/8.1.8 compiler loaded. Use '''module swap''' to ensure an appropriate starting module configuration. |
| 75 | |
| 76 | We have created two other modules required for OpenIFS, shown below: |
| 77 | |
| 78 | {{{ |
| 79 | module show grib_api_cce/0.0.2 |
| 80 | ------------------------------------------------------------------- |
| 81 | /usr/local/packages/oifs/modules/grib_api_cce/0.0.2: |
| 82 | |
| 83 | conflict PrgEnv-gnu |
| 84 | conflict PrgEnv-pgi |
| 85 | conflict PrgEnv-pathscale |
| 86 | prereq cce/8.1.8 |
| 87 | |
| 88 | ECMWF library GRIB_API on HECToR Phase 3 |
| 89 | Open IFS support libraries installed at /work/y07/y07/oifs/install |
| 90 | Platform is cce_8.1.8-il |
| 91 | Version of library GRIB_API is 1.9.18 |
| 92 | setenv GRIB_API_PATH /work/y07/y07/oifs/install/grib_api/1.9.18/cce_8.1.8-il |
| 93 | prepend-path PATH /work/y07/y07/oifs/install/grib_api/1.9.18/cce_8.1.8-il/bin |
| 94 | prepend-path LD_LIBRARY_PATH /work/y07/y07/oifs/install/grib_api/1.9.18/cce_8.1.8-il/lib |
| 95 | setenv GRIB_DEFINITION_PATH /work/y07/y07/oifs/install/grib_api/1.9.18/cce_8.1.8-il/share/grib_api/definitions |
| 96 | setenv GRIB_SAMPLES_PATH /work/y07/y07/oifs/install/grib_api/1.9.18/cce_8.1.8-il/share/grib_api/ifs_samples/grib1_mlgrib2 |
| 97 | module-whatis Support library for ECMWF software : GRIB_API on HECToR Phase 3 |
| 98 | ------------------------------------------------------------------- |
| 99 | }}} |
| 100 | |
| 101 | and |
| 102 | |
| 103 | {{{ |
| 104 | module show fdb_cce/0.0.2 |
| 105 | ------------------------------------------------------------------- |
| 106 | /usr/local/packages/oifs/modules/fdb_cce/0.0.2: |
| 107 | |
| 108 | conflict PrgEnv-gnu |
| 109 | conflict PrgEnv-pgi |
| 110 | conflict PrgEnv-pathscale |
| 111 | prereq cce/8.1.8 |
| 112 | prereq grib_api_cce/0.0.2 |
| 113 | |
| 114 | ECMWF library FDB on HECToR Phase 3 |
| 115 | Open IFS support libraries installed at /work/y07/y07/oifs/install |
| 116 | Platform is cce_8.1.8-il |
| 117 | Version of library FDB is 5.0.0 |
| 118 | Version of library ECKIT is 0.3.0 |
| 119 | setenv ECKIT_PATH /work/y07/y07/oifs/install/eckit/0.3.0/cce_8.1.8-il |
| 120 | prepend-path LD_LIBRARY_PATH /work/y07/y07/oifs/install/eckit/0.3.0/cce_8.1.8-il/lib |
| 121 | setenv FDB_PATH /work/y07/y07/oifs/install/fdb/5.0.0/cce_8.1.8-il |
| 122 | prepend-path PATH /work/y07/y07/oifs/install/fdb/5.0.0/cce_8.1.8-il/bin |
| 123 | prepend-path LD_LIBRARY_PATH /work/y07/y07/oifs/install/fdb/5.0.0/cce_8.1.8-il/lib |
| 124 | module-whatis ECMWF library FDB on HECToR Phase 3 |
| 125 | ------------------------------------------------------------------ |
| 126 | }}} |
102 | | Now you have an executable, you will need some data. The source for data is Glenn Carver at ECMWF; Glenn can provide start data for configurations at several resolutions and for various times. We have several jobs available for model testing at t159, t511 and t1279 resolution. Each job comes with data required to start the model, a namelist defining a set of model parameters, a PBS script (called oifs_job) set up for a "standard" run and an example trace output file. We will give a description of the important parts of the PBS script used to submit jobs to the compute nodes. |
103 | | |
104 | | The file has the usual PBS directives for reserving HPC resource, in this case we have requested 1024 processors with fully populated nodes, for a time limit of 25 minutes. You should edit this to specify your account and email details and change the HPC resource request as appropriate. |
| 154 | Now you have an executable, you will need some data. The source for data is Glenn Carver at ECMWF; Glenn can provide start data for configurations at several resolutions and for various times. We have several jobs available for model testing at t159, t511 and t1279 resolution. Each job comes with data required to start the model, a namelist defining a set of model parameters, a PBS script (called oifs.job) set up for a "standard" run and an example trace output file. We will give a description of the important parts of the PBS script used to submit jobs to the compute nodes. |
| 155 | |
| 156 | === Running the model === |
| 157 | |
| 158 | The file has the usual PBS directives for reserving HPC resource, in this case we have requested 1024 processors with fully populated nodes, for a time limit of 25 minutes. You should edit this to specify your HECToR account and email details and change the HPC resource request as appropriate. |
| 159 | |