Changes between Version 8 and Version 9 of Docs/MirroringStdAncilFiles


Ignore:
Timestamp:
15/07/19 12:11:22 (3 months ago)
Author:
willie
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Docs/MirroringStdAncilFiles

    v8 v9  
    55        The Met Office produces and maintains a standard set of ancillary files on their supercomputers in a comprehensive collection of directories known as the ancillary tree. There are sets of ancillary files at various resolutions for global and limited area domains. The global domains include n512, n96 among others and the limited area domains include m4_288360_uk, ukv. 
    66         
    7         We automatically synchronise a subset of the ancillary tree at the Met Office with the shared directory `/nerc/n02/shared/ancil` on the ARCHER RDF.  This is done weekly on Mondays at 06:00 using a `cron` job on my Met Office PC.  This job launches a script, `do_xfer2`, which, in turn, executes the mirroring script, `mirror_anc_archer`, on the computer els003 at the Met Office in Exeter.  This ensures that the Met Office !Reading/Exeter link is not overloaded. The mirror is directly from Exeter to ARCHER at Edinburgh. 
     7        We automatically synchronise a subset of the ancillary tree at the Met Office with the shared directory `/nerc/n02/shared/ancil` on the ARCHER RDF.  This is done weekly on Mondays at 06:00 using a `cron` job on a Met Office PC (account william.mcginty, Linux user name `frmy`).  This job launches a script, `do_xfer2`, which, in turn, executes the mirroring script, `mirror_anc_archer`, on the computer els003 at the Met Office in Exeter.  This ensures that the Met Office !Reading/Exeter link is not overloaded. The mirror is directly from Exeter to ARCHER at Edinburgh. 
    88         
    99        A record of the transfer is kept on my Met Office PC. 
     
    1111        On ARCHER in `/home/y07/y07/umshared/scripts` there is a PBS script, sync_ancil, which is run weekly on Thursday at 19:30 which mirrors again the RDF directory into the  shared $UMDIR/ancil directory on the Lustre file system. 
    1212         
    13         The section of the ancillary tree on ARCHER comprises roughly 5.5 TB of data and is growing. 
    14  
    15         The scripts involved are stored on PUMA in my `remote_computer_scripts` directory. 
     13        The scripts involved are stored on PUMA (test) in `/home/willie/Documents/remote_scripts`. 
    1614 
    1715