News and Announcements

Post-processing for ARCHER/NEXCS plus transfer to JASMIN released

Modifications to the Met Office post-processing app to enable archiving on ARCHER/NEXCS and automatic transfer of data from the RDF/NEXCS to JASMIN have now been incorporated into the Met Office trunk and released as part of postproc version postproc_2.2.

Instructions on how to upgrade the postprocessing in your Rose suites is available on the CMS website: Post-Processing App

CMS closure dates

The CMS team will be unavailable from 22 December 2017 until 2 January 2018, due to University closure over the holiday period. We will deal with any helpdesk queries or other issues on our return. We wish you all an enjoyable holiday!

NCAS Data Tools first training course on 21st September 2017

The first training course for 20 people on the NCAS data tools cf-python and cf-plot was held at Reading University on the 21st September 2017. Another training course to be held on 2nd October is already full. If you are interested in attending a one day course please register your interest by emailing Andy Heaps andy.heaps at

The cf-python and cf-plot Python packages build on the CF metadata conventions to provide powerful extraction, regridding and visualization capabilities of netCDF, Met Office PP and fields files. Operations such as reading, grid transformation and plotting of contours and vectors can be performed in a single line making for quick analysis and plotting of data.

Further information on the tools and capabilities can be found at:

training class at Reaing University

Rose/Cylc UM conversion course (5th May 2017)

NCAS-CMS will be running a 1-day Rose/Cylc UM conversion course on Friday 5th May at Reading University. Rose & Cylc are the replacement user interface and job submission/control system for the UMUI for UM version 10.x. The course is aimed at those already familiar with running the UM under the UMUI and will not cover how the UM itself works. (See our UM Training course page for details of other courses we run: The majority of the course will be hands-on exercises supplemented with lectures.

Course contents:

  • Overview of Rose/Cylc
  • Creating & managing suites
  • How to configure, build and run a UM application
  • Examining Rose suite output
  • Common pitfalls and troubleshooting

Please only attend this course if you are planning on using Rose within the next few months. We will be running this course again later in the year, subject to demand.

We still have a few spaces left. To register for this course please email: cms-support@… including a brief summary of what model configurations/versions you intend to be working with.

Course attendees are responsible for paying their own travel costs.

CF Checker 3.0.0 Released

A new version of the CF Checker has been released and is now available for download from Github ( A distribution will also be available on PyPI soon.

This is a major update to remove the dependency on CDAT; moving to use netcdf4-python instead.

UM Introduction Course (29-31 March 2017)

NCAS-CMS will be delivering a 3-day course introducing new users to the Met Office Unified Model with the new Rose/cylc system. The course is a mix of practical exercises and informal lectures covering a range of topics including running suites, code management, file formats and troubleshooting common problems.

The course will be held at the University of Reading from 29-31 March 2017. There is no fee for attending the course, and lunch will be provided. However attendees are responsible for their own travel, accommodation and other subsistence costs.

For further details and a link to the registration form see:

Please note, this course is intended for new UM users only. CMS will also be running a 1 day Rose/cylc conversion course for users familiar with running the UM through the UMUI. Details of this will follow soon.

UM Training November 2016

We recently ran the first, this academic year, of our popular 3 day UM Introduction courses. The course was attended by researchers from around the UK, as well as 3 participants from the US.

For the first time the course focused entirely on running the UM through the Rose/cylc interface. Attendees worked through a series of exercises designed to help users become familiar with the UM software, including how to diagnose common problems. We also had 2 very interesting science talks from Carol Halliwell and Sylvia Bohnenstengel of the Met Office.

The course was very well received with everyone who responded to our request for feedback (11 out of 19 participants) rating the lectures, practicals and facilities good or excellent.

The next course will run 29-31 March 2017, with registration opening in January 2017. For more details see:

Mule utilities available on ARCHER

The Met Office recently released version 1.3 of Mule. Mule is a Python API for reading & writing UM format files, and a set of utilities to replace the UM executables such as cumf and pumf.

For more information on Mule, see the user guide: (Note you will need a MOSRS account to view this page.)

Mule is available on ARCHER for the serial and login nodes. To use, a one-off setup step is required to add the Mule library to your Python path. For instructions see: wiki:ToolsAndUtilities/mule

GA7 Optimizations

Work undertaken to optimise Pier Luigi Vidale's N512 GA7 runs by NCAS-CMS has resulted in a 15-20% speed up of the model with no loss of bit-comparison. The savings in ARCHER resource resulting from this effort are very significant - at ARCHER partner rate this is ~£60k, and twice that at the non-partner rate. Another way of looking at this is that we save ~100M AU (for these experiments) which enables a raft of ARCHER projects which may struggle otherwise.

Details follow:

In the standard GA7, stochastic physics is turned on. This holds a field in spectral space distributed over the PEs. Every timestep this field is gathered by PE0, converted to grid space and then distributed over the domain. This requires a gather and many scatters at everytime timestep. A month long N512 high resolution job was examined with drhoook and it was noted that FOR_PATTERN, the routine which does the gather/scatter and spectral→grid space transformation takes a significant proportion of the run time, 513s for a 3000s run.

FOR_PATTERN has been rewritten to remove all gathers and scatters of the spectral field. Instead of having the spectral rows distributed over all PEs, each PE holds the spectral rows equivalent to its own rows in grid space. It then does a local fourier transform to get back to grid space, and then extracts the its own longitude domain from the resultant field.

This requires extra compute as every PE over a latitude band does the same spectral→grid space transformation, but the savings communication times can far outweigh this. Gather/scatters when running on a large number (1000s) of PEs are best avoided as these can take many milliseconds to perform.

With it new code FOR_PATTERN takes 23s, compared with 513s.

Two test jobs have been run. A high resolution N512 and an AMIP N96 configuration. For both there is full bit compariability with the previous version.

The N512 GA7 is now being run on Archer with this branch. The speed increase, from Pier Luigi Vidale:

So, for two domain decompositions and for a 2-month dump at N512: 48x48: ~7 hours, but a few times as short as 6hrs40mins (down from ~8 hours) 48x72: 4hrs50m to 5hrs02m (down from ~6hours)

So a ~15%-20% speed up

For the AMIP GA7 runs, there was no discernable speed change, but this isn't surprising as the gather/scatter would be much faster whilst running on a low number of PEs

UM Training April 2016

We recently delivered the second of our bi-annual 3-day UM Training courses. This time we hosted 16 attendees from a wide range institutions from across the UK. Three days of hard work running and breaking UM jobs on ARCHER with specialist presentations from MO, and NCAS experts. This was our final UMUI-centric training course, next time Rose/Cylc will be the main focus. Many thanks to those attending and presenting.

Course details and presentations are available here.

The course photo sees us hard at work:

Last modified 3 years ago Last modified on 02/10/15 16:20:56