wiki:Projects/OpenIFS-local

OpenIFS-local

In response to a request for a local installation of OpenIFS for use in an MSc project (Bob Plant and Alice Gill) with possible extension to departmental-wide usage, Jeff Cole has developed the required infrastructure to enable OpenIFS to run on an NCAS sever (um2).

Glenn Carver (ECMWF) recently updated the PUMA OpenIFS repository with version 38r1v02; Jeff has created a branch for use on um2.

[Effort: 2 weeks]

How to run OpenIFS on um2

1) Add the following line to your .profile

. $HOME/oifs.setup

2) Copy /home/oifs/oifs.setup to your home directory

cp /home/oifs/oifs.setup ~

3) Login to um2

ssh -X username@um2

4) Create oifs directory and cd into it

mkdir ~/oifs
cd ~/oifs

5) Extract IFS code from repository, including branch which sets up the code to
run on um2

fcm checkout fcm:oifs/branches/dev/jeff/r22_run_on_um2

6) Build IFS executable

cd r22_run_on_um2/make
fcm make -j 4 -v -f oifs.cfg

7) cd to your IFS run directory, should be on a data disk not your home directory, e.g.

cd /panfs/jasmin/users/username/oifs/

8) Copy over/download your IFS experiment data and cd to your run directory

9) Copy run script from IFS code

cp ~/oifs/r22_run_on_um2/examples/ifs_run.sh .

10) Run model

./ifs_run.sh -e OIFS_EXPID -m ~/oifs/r22_run_on_um2/make/gnu-opt/oifs/bin/master.exe -r OIFS_RES -n NPROC -f FCLEN -x OIFS_RUN 2>&1 | tee run.out

where

OIFS_RES   : model resolution, e.g. 511
OIFS_EXPID : model experiment id - must match string in filenames
NPROC      : number of MPI tasks, e.g. 24 for t511 resolution
FCLEN      : Run length, dxx days; hxx hours; txxx timesteps, e.g. d10 for a 10 day run

see ifs_run.sh script for further arguments.

Timings

Initial testing with a t511 model gives the timing results

Number of MPI tasks quickest time for 1 Timestep (seconds)
64 59
48 56
32 43
24 43
16 57
Last modified 2 years ago Last modified on 01/09/15 16:24:45