Opened 5 months ago

Closed 5 months ago

#3382 closed help (answered)

Submit multiple UMUI jobs on external HPC without requiring password for every job

Reported by: watson Owned by: um_support
Component: UM Model Keywords:
Cc: Platform:
UM Version:

Description

Hello, I recently started running UMUI jobs on a university HPC system with the new Puma security imposed. Our current submission script runs on the HPC system and works by copying over job files processed by the UMUI and then running commands there to submit the job. With the new Puma security, it seems that a password is required every time a job is submitted this way in order to copy the files. When trying to submit a couple of dozen jobs in one go, this is rather cumbersome. Is there a solution that doesn't require a password every time?

Change History (8)

comment:1 Changed 5 months ago by grenville

Peter

There may be a way round this with ssh-multiplexing. We has a similar problem in reverse when ARCHER went 2FA. This s the solution we used to go from PUMA to ARCHER to avoid typing ARCHER passwords endlessly (you will need to set this up from your HPC to PUMA — I don't know if your HPC will support this of course)

in your PUMA or pumatest .ssh/config file, delete references to login.archer.ac.uk and then add:

Host login.archer.ac.uk
User <your ARCHER username>
IdentityFile ~/.ssh/<your private key to ARCHER>
ControlMaster auto
ControlPath /tmp/ssh-socket-%r@%h-%p
ControlPersist yes

login to ARCHER (with passphrase and password).

Grenville

Last edited 5 months ago by ros (previous) (diff)

comment:2 Changed 5 months ago by grenville

Peter

That didn't format as I'd hoped - all the text after in your PUMA… should be italic to indicate that it all refers to our solution and will need to be tweaked for your case.

Grenville

comment:3 Changed 5 months ago by watson

Thanks Grenville. I tried that but the last three options seemed to result in an error message. I'll follow up with the HPC admins.

comment:4 Changed 5 months ago by watson

The HPC admins pointed out that removing the question marks might help, and then I don't get the error message. But I still need to enter my puma password to connect. Do you think this would be because of the settings on the HPC system?

comment:5 Changed 5 months ago by ros

Hi Peter,

You should only need to enter your PUMA password for the first connection. Then subsequent ones use the master socket that is set up. This connection should persist for an amount of time (which will depend on system setups).

Cheers,
Ros.

comment:6 Changed 5 months ago by grenville

Peter

The question marks were put in by some machine intelligence!

Grenville

comment:7 Changed 5 months ago by watson

Thanks both, it seems to be working now.

Peter

comment:8 Changed 5 months ago by grenville

  • Resolution set to answered
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.