| 150 | |
| 151 | |
| 152 | |
| 153 | |
| 154 | |
| 155 | = Setting up UM 8.4 to run on Polaris = |
| 156 | |
| 157 | == 1 Central Installation Directory Structure == |
| 158 | The vn 8.4 installation is under /home/polaris_lds1/earhum/vn8.4/. |
| 159 | |
| 160 | |
| 161 | == 2 Your Setup on Polaris == |
| 162 | Copy the UM Setup section from /home/polaris_lds1/ldsgl/.bashrc to your .bashrc. In order to use vn 8.4 utilities make sure you source .umsetvars_8.4. |
| 163 | |
| 164 | == 3 Model Build Information and UMUI Settings == |
| 165 | The model build information is kept in configuration files which are read by the FCM build system. The appropriate compiler flags are used to build the model along with information about which libraries to link. We have used the following flags for the Polaris intel compiler for both model and communications builds |
| 166 | |
| 167 | {{{-i8 -r8 -fp-model precise -O1}}} |
| 168 | |
| 169 | |
| 170 | |
| 171 | |
| 172 | === FCM Branches === |
| 173 | |
| 174 | Navigate to ''model selection -> FCM configuration -> FCM options for atmosphere and reconfiguration'' and include the following branch |
| 175 | |
| 176 | |
| 177 | {{{fcm:um_br/dev/grenville/vn8.4_polaris/src}}} |
| 178 | |
| 179 | in the '''User Modifications''' table. The naming of this necessary branch may change in future - this branch contains a script change needed to ensure CRUNS behave correctly. |
| 180 | |
| 181 | |
| 182 | |
| 183 | === General UMUI Settings === |
| 184 | |
| 185 | Navigate to ''model selection -> FCM configuration -> FCM extract directories and output levels ''. |
| 186 | Experience will help determine the most convenient places where the extracted model should reside. Explicitly set '''UM_ROUTDIR''' to be your user directory on /nobackup, however, note that files left in this directory may be marked for deletion in accordance with Polaris data policy. |
| 187 | |
| 188 | Navigate to ''model selection -> user information and submit method -> general details'' |
| 189 | Set '''User-id''' to be your Polaris id. The '''Tic Code''' is not relevant to Polaris. We have not tested end of run email notification. |
| 190 | |
| 191 | Navigate to ''model selection -> user information and target machine -> job submission method'' |
| 192 | Choose the option ''''qsub' for SGE(SGI)''' for the submission method, enter polaris.leeds.ac.uk for the '''Host name''', select '''Change machine config file''' and enter '''sgi-intel-polaris'''. We note that OpenMP works on Polaris, but there appears to be an issue with MPI multi-threading which prevents the use of the UM I/O servers, in which case, navigate to ''model selection -> input/output control and resources -> IO services'' and set '''Number of IO servers''' to "0" |
| 193 | |
| 194 | Navigate to ''model selection -> input/output control and resources -> user hand edit files'' and include '''/home/grenville/umui_jobs/hand_edits/polaris_8.4.1''' in the Hand edits list. This is currently necessary to mange the way Polaris handles the module command in the k shell. Future work should see the need for this to disappear. |
| 195 | |
| 196 | |
| 197 | == 4 Example UMUI Job == |
| 198 | The following job is currently under user grenville in the UMUI |
| 199 | ||Job Id|| Model || |
| 200 | ||xidew||HadGEM3-GA4.0 Polaris|| |
| 201 | |
| 202 | |
| 203 | |
| 204 | |
| 205 | |