Cylc 8
Cylc 8 on PUMA2 and ARCHER2
Cylc 8 is available on PUMA2 and ARCHER2, but we are still in the process of testing, porting key workflows, and developing user documentation. We are also working on deploying the web-based GUI.
At this stage the software configuration is still subject to change.
See the links below for further information on Cylc 8. Report any issues to the helpdesk.
Overview
Cylc 8 replaces the Python 2 based Cylc 7 software. It is a complete rewrite in Python 3 and contains many changes from Cylc 7, so we encourage you to look at the documentation.
Useful links:
Note that in Cylc 8 terminology “suites” have become “workflows”.
ARCHER2 workflows
Cylc-8 workflows available on ARCHER2:
| Cylc 8 id | Cylc 7 id | Description |
|---|---|---|
| u-de385 | u-cy010 | GC5-UM |
| u-dj397 | u-cc519 | N48 GA6 (training suite) |
See the instructions for migrating an ARCHER2 Cylc 7 suite to Cylc 8.
Using Cylc 8 on PUMA2 and ARCHER2
Setting the Cylc version
Set the Cylc version in the terminal:
export CYLC_VERSION=8
You should be able to do this alongside any Cylc 7 suites you have running.
Assuming you have set up your ARCHER2 environment (and JASMIN if required) to have Cylc 7 available, you should not need to make any further changes. The workflow will simply pick up the appropriate Cylc version when it runs.
Running a workflow
To run a simple test, checkout u-dj397
rosie co u-dj397
Set your username and project account in rose-suite.conf or in the GUI via rose edit.
Run the workflow with:
cylc vip
Launch the terminal user interface to check on progress:
cylc tui u-dj397
See the Cylc 8 cheat sheet for an overview of Cylc 8 commands.
Further information
Platforms
Tasks are assigned a “platform”, which combines the host and job running method. See the Cylc 8 platform documentation for details.
On PUMA2 the following platforms are available:
- PUMA2:
localhost: background job
- ARCHER2:
archer2: Slurm jobarcher2_bg: background on random login nodeln0[1-4]: background job on specific login node
- ARCHER2 with the
cylc-run/runN/share/andwork/directories symlinked to the NVMe file system:archer2_nvme: Slurm jobarcher2_nvme_bg: background on random login nodeln0[1-4]_nvme: background job on specific login node
- JASMIN:
lotus: Slurm jobsci_bg: background job on random sci machinesci[1-8]: background job on specific sci machine
Note that multiplexing is no longer needed to submit jobs to Jasmin. There are still some issues if a host is not available or not fully functional, due to be fixed at Cylc 8.3.5.
We are working on support for submission to the new Jasmin servers as these become available.
You can test submission to each of the platforms with the workflow u-dj398.