wiki:Projects/INSPECT/NEMOTAM

Version 3 (modified by annette, 8 years ago) (diff)

NEMOAM test run

12 August 2013

We installed and ran the example ORCA2 NEMO-TAM experiment provided with the NEMO 3.4.1 source code, following the instructions on the main NEMO website: http://www.nemo-ocean.eu/Using-NEMO/User-Guides/Basics/Tangent-and-Adjoint-quick-start-guide

Information and instructions for running locally are given below:

  • Input data
  • Timing runs
  • Instructions

Input data

The input files are located here: /net/jasmin/users/annette/nemo/ORCA2_LIM_nemo_v3.4

This is the ORCA2_LIM v3.4 data set mentioned here:

http://www.nemo-ocean.eu/Using-NEMO/Configurations/ORCA2_LIM-and-AGRIF-demonstrator

Timing runs

The times taken to run 75 timesteps (5 model days), based on the 'time' command around the model executable. This includes writing of restart files but not diagnostic history files.

NEMO

1 proc  -> 3m17.43s
4 proc  -> 1m6.12s
8 proc  -> 0m55.86s
16 proc -> 1m29.75s

TAM

1 proc  -> 1m29.24s
4 proc  -> 0m34.25s
8 proc  -> ERROR
16 proc -> 0m43.27s

Instructions for running locally

To run a single processor experiment. Instructions to be updated for building with fcm make.

Step 1) Set up environment for um[12]

a) To ensure the supporting software is available, add the following lines to your local .kshrc file:

if [ `uname -n` = 'um1' -o `uname -n` = 'um2' ]
then 

  ulimit -c unlimited
  ulimit -s unlimited
  . /net/jasmin/users/simon/intel/composerxe\-2011.4.191/bin/compilervars.sh intel64
  export PATH=/home/jeff/linux_x86_64/mpich2-install/bin:$PATH
  export LD_LIBRARY_PATH=/panfs/jasmin/users/annette/netcdf/intel/lib:$LD_LIBRARY_PATH   
  export PATH=/net/jasmin/users/annette/fcm/bin:$PATH
  export PATH=/net/jasmin/users/annette/nemo/rebuild:$PATH

fi

Step 2) Extract code to um servers (you need to be on PUMA for this step)

a) Create a directory to extract NEMO code to eg:

mkdir ~/nemotam/v3.4.1_test
cd ~/nemotam/v3.4.1_test

b) Copy fcm configuration file:

cp ~annette/nemotam/v3.4.1_test/fcm-make.cfg . 

c) Edit file to use own username and directory on um servers:

mirror.target = <user>@<server>:<path-on-remote-machine>/v3.4.1_test

d) Run extract (ignore warnings about SYMLINKS)

fcm make 

This extracts the v3.4.1 branch and copies over to your data-space.

Step 3) Build ORCA2 NEMO and NEMOTAM on um servers

a) Go to directory created on um eg:

cd /net/jasmin/users/annette/nemotam/v3.4.1_test/extract

b) Copy compilation configuration file for um machines:

cd nemo/NEMOGCM/ARCH
cp /net/jasmin/users/annette/nemotam/arch-ifort_linux_um.fcm .

c) Build:

cd ../CONFIG
makenemo –m ifort_linux_um –r ORCA2_TAM -n MY_ORCA2_TAM

Step 4) Run direct NEMO model

a) Go to experiment directory created in build steps:

cd MY_ORCA2_TAM/EXP00 

b) Copy over example run script:

cp /net/jasmin/users/annette/nemotam/run_opa.ksh . 

change CCFGDIR to pint to your MY_ORCA_TAM

c) Run model:

./run_opa.ksh 

Output in:

./Run1/

Step 5) Run NEMO-TAM model

a) Go back to experiment directory EXP00

cd ../  

b) Copy over example run script:

cp /net/jasmin/users/annette/nemotam/run_tam.ksh . 

change CCFGDIR to pint to your MY_ORCA_TAM

c) Run TAM model:

./run_tam.ksh 

Output in same place as main model:

./Run1/