Opened 6 months ago

Closed 6 months ago

#3388 closed help (fixed)

Transition CDO post-processing from LSF to SLURM

Reported by: mtodt Owned by: um_support
Component: JASMIN Keywords: SLURM CDO
Cc: Platform: JASMIN
UM Version:

Description

Hi

I'm trying to translate a post-processing script that uses CDO from .bsub to .sbatch. It worked fine before (on jasmin-sci*.ceda), now (on sci*.jasmin) I noticed that I have to load jaspy to use CDO, so I added that to my script. However, the job fails with the following error message:

cpu-bind=MASK - host142, task  0  0 [19492]: mask 0xffff set FAILED
slurmstepd: error: Failed to invoke task plugins: task_p_pre_launch error

I honestly have no idea what to make of this, so any help would be much appreciated!

Cheers
Markus

Change History (6)

comment:1 Changed 6 months ago by pmcguire

Hi Markus:
Where is the '.sbatch' script that you're referring to?
Patrick

comment:2 Changed 6 months ago by mtodt

Hi Patrick

Thanks for looking into this! It's PostProcessing.sbatch under /home/users/mtodt/Data/ModelOutput/WFDEI/Repeat_postprocessed/irr_crop_0.

Cheers
Markus

comment:3 Changed 6 months ago by pmcguire

Hi Markus:
I ran your SLURM script PostProcessing.sbatch on JASMIN. It didn't have the error message that you had. Can you try to rerun it?
It might have run just fine when I ran it if I had changed the output directory. My copy is in ~pmcguire/test/mtodt, including the the log files from running it. I am signing out for the weekend. Can you send further help requests after the weekend is over?
Patrick

comment:4 Changed 6 months ago by mtodt

Hi Patrick

I had done that yesterday and it didn't work, but I'll try it again. I was hoping to solve it before the weekend since I have the same problem with my JULES runs, but I couldn't find any other ticket with this problem.

Cheers
Markus

comment:5 Changed 6 months ago by mtodt

Hi Patrick

It's indeed working now. Who know's what happened the other days. Thanks a lot!

Cheers
Markus

comment:6 Changed 6 months ago by mtodt

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.