Changes between Version 4 and Version 5 of Docs/MirroringStdAncilFiles


Ignore:
Timestamp:
22/03/19 11:57:59 (5 months ago)
Author:
willie
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Docs/MirroringStdAncilFiles

    v4 v5  
    55        The Met Office produces and maintains a standard set of ancillary files on their supercomputers in a comprehensive collection of directories known as the ancillary tree. There are sets of ancillary files at various resolutions for global and limited area domains. The global domains include n512, n96 among others and the limited area domains include m4_288360_uk, ukv. 
    66         
    7         We automatically synchronise a subset of the ancillary tree at the Met Office with the shared directory /nerc/n02/shared/ancil on the ARCHER RDF.  This is done weekly on Mondays at 06:00 using a cron job on my Met Office PC.  This job launches a script, do_xfer, which, in turn, executes the mirroring script, `mirror_anc_archer`, on the computer els003 at the Met Office in Exeter.  This ensures that the Met Office !Reading/Exeter link is not overloaded. The mirror is directly from Exeter to ARCHER at Edinburgh. 
     7        We automatically synchronise a subset of the ancillary tree at the Met Office with the shared directory `/nerc/n02/shared/ancil` on the ARCHER RDF.  This is done weekly on Mondays at 06:00 using a `cron` job on my Met Office PC.  This job launches a script, `do_xfer2`, which, in turn, executes the mirroring script, `mirror_anc_archer`, on the computer els003 at the Met Office in Exeter.  This ensures that the Met Office !Reading/Exeter link is not overloaded. The mirror is directly from Exeter to ARCHER at Edinburgh. 
    88         
    99        A record of the transfer is kept on my Met Office PC. 
    1010         
    11         On ARCHER in /home/y07/y07/umshared/scripts there is a PBS script, sync_ancil, which is run weekly on Thursday at 19:30 which mirrors again the RDF directory into the  shared $UMDIR/ancil directory on the Lustre file system. 
     11        On ARCHER in `/home/y07/y07/umshared/scripts` there is a PBS script, sync_ancil, which is run weekly on Thursday at 19:30 which mirrors again the RDF directory into the  shared $UMDIR/ancil directory on the Lustre file system. 
    1212         
    1313        The section of the ancillary tree on ARCHER comprises roughly 5.5 TB of data and is growing. 
    1414 
    15         The scripts involved are stored on PUMA in my scripts directory. 
     15        The scripts involved are stored on PUMA in my `remote_computer_scripts` directory. 
    1616