Opened 5 months ago

Closed 5 months ago

#2737 closed help (fixed)

rose suite share directory

Reported by: cthomas Owned by: ros
Component: Rose/Cylc Keywords: rose,cylc
Cc: Platform: Monsoon2
UM Version:

Description

Hello,

I recently restarted a Rose suite (using rose suite-run) after it stopped on a particular day.
I noticed that it deleted my $DATADIR/cylc-run/<suite-id>/share/cycle directory, which has never happened before. Is that a recent development based on the version of Cylc?

Thanks,
Chris

Change History (13)

comment:1 Changed 5 months ago by ros

  • Owner changed from um_support to ros
  • Status changed from new to accepted

Hi Chris,

I'm not aware of any changes in the behaviour of cylc in this regard. Without knowing exactly what commands you ran and being able to view the log files it's very difficult to comment.

Regards,
Ros.

comment:2 Changed 5 months ago by cthomas

Hi Ros,

I was running the suite u-be158. I have also tried u-be259, running it from the start, and have noticed that the output is being placed here:

/scratch/d03/chrth/cylc-run/u-be259/share/cycle

whereas before it would have gone here:

/projects/jomp/chrth/cylc-run/u-be259/share/cycle

Has something changed recently regarding the use of /scratch?
If it's any use, I am in the jomp and jodap groups (among others).

Thanks,
Chris

comment:3 Changed 5 months ago by ros

Hi Chris,

It looks like rose is now configured to make the directory $DATADIR/cylc-run/<suite-id>/share/cycle as a symbolic link to /scratch. It has done so for all my suites too; I just hadn't noticed as I'd not listed the directory. All the model data will still be placed in $DATADIR. I presume you are now running rose on the login nodes rather than exvmsrose; I suspect that this is a planned configuration change with the move from exvmsrose.

Cheers,
Ros.

comment:4 Changed 5 months ago by cthomas

Hi Ros,

Thanks for looking into this. Yes, I am running directly from xcs now. When I was using exvmsrose, I looked in the share/cycle directory to find the output files of interest. I tended to periodically delete everything that appeared in work, since it contained things like individual processor outputs. If possible I would like to continue working like that, but I guess the /scratch disk will be regularly emptied.

If I correctly set the variable root-dir{share/cycle} in the suite will that fix things?

I could also write a script to move files from /scratch to the share/cycle directory, or just access them in work instead.

Cheers,
Chris

comment:5 Changed 5 months ago by ros

Hi Chris,

I will confirm with the Met Office that this is an intended change or not.

Cheers,
Ros.

comment:6 Changed 5 months ago by ros

Hi Chris,

I've spoken the Met Office and have been told that symbolically linking the share/cycle directory to /scratch is the default behaviour. This is what happens on the internal part of the XCS too. The share/cycle/CYCLE ($ROSE_DATAC) directories are expected to persist only while the cycle is relevant; as such they are only temporary directories intended for tasks to share data. The normal behaviour of cycling suites is to house keep share/cylc/CYCLE/ sub-directories as the suite rolls on. If this is not desirable, items should be placed under share/ or share/data $ROSE_DATA instead.

You could try changing share/cycle and see if that does what you want but be careful that it doesn't have any other side effects.

Regards,
Ros.

comment:7 Changed 5 months ago by cthomas

Hi Ros,

OK, that makes sense. I will try using share/data initially, and try changing the variable if that doesn't work.
Thanks,
Chris

comment:8 Changed 5 months ago by cthomas

Hi Ros,

I have been using $ROSE_DATAM but it seems to be putting things in my home directory, rather than linking to $DATADIR. Do I need to configure something else to get that to work?

Thanks,
Chris

comment:9 Changed 5 months ago by ros

Hi Chris,

Looks like the symlinking of $HOME/cylc-run/SUITE to $DATADIR has stopped working. I've just sent an email to the Met Office.

Cheers,
Ros.

comment:10 Changed 5 months ago by cthomas

Hi Ros,

I have got around this by hardcoding the path to $DATADIR in the suite. It's not perfect, but is OK for now. It would be interesting to know if the change you mentioned can be reverted (or another option is available).

Thanks,
Chris

comment:11 Changed 5 months ago by ros

Hi Chris,

I'm in discussions with the Met Office. There is currently a problem with the automatic setting of DATADIR by the system which means rose can't be configured to put in the symlink. You workaround is fine for now. Once a plan has been agreed I'll update here or information will be posted on the yammer groups.

Cheers,
Ros.

comment:12 Changed 5 months ago by ros

Hi Chris,

The issue with setting of DATADIR has now been resolved and Rose configured again to put in appropriate symlinks for share/

Cheers,
Ros.

comment:13 Changed 5 months ago by cthomas

  • Resolution set to fixed
  • Status changed from accepted to closed

Hi Ros,

Great, thanks a lot!
Cheers,
Chris

Note: See TracTickets for help on using tickets.