Opened 3 months ago

Closed 3 months ago

Last modified 3 months ago

#3240 closed help (answered)

JASMIN - Set up SFTP session for Data transfer to Desktop

Reported by: NoelClancy Owned by: pmcguire
Component: Data Keywords: JASMIN, VPN, puma, ssh, scp, sftp
Cc: Platform: JASMIN
UM Version:

Description

Patrick,
you set up a shortcut on my Desk PC to help me transfer plots from JASMIN
to my Desk PC

Attachments (1)

File_Transfer_Session.PNG (30.7 KB) - added by NoelClancy 3 months ago.

Download all attachments as: .zip

Change History (20)

comment:1 Changed 3 months ago by pmcguire

  • Owner changed from um_support to pmcguire
  • Status changed from new to assigned

Hi Noel
Yes, I did.
What is the question? Or what is the issue?
Patrick

comment:2 Changed 3 months ago by pmcguire

Hi Noel:
Is the question that you are asking:
"Could you help me do it again?"

The answer is "yes".

What have you tried so far?
Patrick

Changed 3 months ago by NoelClancy

comment:3 Changed 3 months ago by NoelClancy

Patrick,

I've attached a screenshot.

But I can't open JASMIN gws on the file transfer session so don't know where I am going wrong.

You could walk me though it if I showed you my screen on Teams?

comment:4 Changed 3 months ago by pmcguire

Hi Noel
Those are similar settings to what I have for jasmin-xfer1 in MobaXterm.

You're using the University VPN, right?

If you open up a terminal window in MobaXterm, can you successfully do any these commands?:

 ssh -AX jasmin-login1.ceda.ac.uk 
 ssh -AX jasmin-xfer1.ceda.ac.uk
 ssh -AX jasmin-xfer1

If that doesn't work, can you try this?:
In your terminal window in MobaXterm, type vi ~/.ssh/config, and make sure you have lines like the following in it, and if you don't then add them. You'll have to find the local path for your IdentityFile.

Host jlogin1
Hostname jasmin-login1.ceda.ac.uk
IdentityFile /drives/c/Users/NoelClancyUniversityIDWhateverItIs/.ssh/id_rsa_jasmin
User nmc
ForwardAgent yes

Host jasmin-xfer1
HostName jasmin-xfer1.ceda.ac.uk
User nmc
ForwardAgent yes
ProxyCommand ssh -AX jlogin1 -W %h:%p

Host jasmin-xfer1.ceda.ac.uk
User nmc
ForwardAgent yes
ProxyCommand ssh -AX jlogin1 -W %h:%p

Then try the ssh commands again, and if those work, try the sftp icon again for jasmin-xfer1.

You might have to modify these commands to get this to work. Let me know if you get it working and if you needed to change anything.
Patrick

comment:5 Changed 3 months ago by NoelClancy

Patrick

I am currently not using the VPN, Pier Luigi told me to logon to jasmin-logon2 to avoid the VPN

comment:6 Changed 3 months ago by NoelClancy

But maybe I will need to connect to the VPN for the jasmin-xfer1.ceda.ac.uk transfer session

Is there a way to set up a session without the VPN, like jasmin-logon2?

comment:7 Changed 3 months ago by NoelClancy

vi ~/.ssh/config doesn't work for me as I have not got the sub-directory config

I can cd ~/.ssh
but no "config" exists?

comment:8 Changed 3 months ago by NoelClancy

ok when I log in to jasmin-login2

(base) [nmc@jasmin-login2 .ssh]$ ls
authorized_keys config known_hosts

(base) [nmc@jasmin-login2 .ssh]$ vi config

# .ssh/config
Host xfer1

Hostname jasmin-xfer1.ceda.ac.uk
User nmc
ForwardAgent? yes

Host jasmin-sci1.ceda.ac.uk

User nmc
ForwardAgent? yes
ProxyCommand? ssh -Y xfer1 -W %h:%p

Host jasmin-sci2.ceda.ac.uk

User nmc
ForwardAgent? yes
ProxyCommand? ssh -Y xfer1 -W %h:%p

Host jasmin-sci3.ceda.ac.uk

User nmc
ForwardAgent? yes
ProxyCommand? ssh -Y xfer1 -W %h:%p

Host jasmin-cylc.ceda.ac.uk

User nmc
ForwardAgent? yes

ProxyCommand? ssh -Y xfer1 -W %h:%p

comment:9 Changed 3 months ago by NoelClancy

I don't understand what you mean by finding the path to my IdentityFile??

comment:10 Changed 3 months ago by pmcguire

Hi Noel:
With logging in (directly) to jasmin-login2 from your PC, you can't do any file transfer from JASMIN directly to your PC.
With the VPN and jasmin-login1, you can do this.

How much data do you want to transfer? Do you have a puma or an oak account? Do your quotas on puma or oak allow sufficient space for transferring from JASMIN to puma or oak? After you do that transfer from JASMIN to puma or oak, then you can transfer from puma or oak to your PC.
Patrick

comment:11 Changed 3 months ago by pmcguire

Hi Noel:
However, jasmin-login1 should be working again. So you can use jasmin-login1 with the VPN, instead of using jasmin-login2 without the VPN. And then you can do your transfers from jasmin-xfer1 directly to your PC when you are on the VPN.
Patrick

Last edited 3 months ago by pmcguire (previous) (diff)

comment:12 Changed 3 months ago by NoelClancy

Patrick,

Thanks very much.
I have done that now using the VPN and jasmin-login1
and then jasmin-xfer1

I only want to transfer plots from JASMIN so that I can upload them to Overleaf/Latex? for the analysis I'm writing up at the moment.

Your help this morning has enabled me to do that, thanks v much -TICKET CLOSED

I don't have an oak account put I do have a PUMA account.

If I cannot get on to the VPN would PUMA be an option?
NoelClancy?@puma.nerc.ac.uk

However, I don't know what quota I have on there. Is there a command that can tell you this?

Noel

comment:13 Changed 3 months ago by pmcguire

Hi Noel
Glad that it works now.
If you log in to puma, you can type the command 'quota'.
People usually have a quota there of a small number of GigaBytes (GB).
Patrick

comment:14 Changed 3 months ago by NoelClancy

NoelClancy?@puma:/home/NoelClancy> quota
Disk quotas for user NoelClancy? (uid 2088):

Filesystem blocks quota limit grace files quota limit grace

/dev/sdb3 277080 1000000 1100000 17815 0 0

comment:15 Changed 3 months ago by NoelClancy

NoelClancy?@puma:/home/NoelClancy> quota
Disk quotas for user NoelClancy? (uid 2088):

Filesystem /dev/sdb3
blocks 277080
quota 1000000
limit 1100000
grace
files 17815
quota 0
limit 0
grace

comment:16 Changed 3 months ago by pmcguire

Hi Noel:
yes, so the quota says you have 1000000 kBytes or 1 GB available there on puma.
Patrick

Last edited 3 months ago by pmcguire (previous) (diff)

comment:17 Changed 3 months ago by NoelClancy

Thanks Ptrick, I tested doing it without the VPN also and it works

(base) [nmc@jasmin-login2 plots]$
scp *.pdf NoelClancy?@puma.nerc.ac.uk:~/plots

cd /home/mobaxterm
mkdir plots
cd plots
scp NoelClancy?@puma.nerc.ac.uk:/home/NoelClancy/plots/*pdf ./

TICKET CLOSED

comment:18 Changed 3 months ago by pmcguire

  • Resolution set to answered
  • Status changed from assigned to closed

comment:19 Changed 3 months ago by pmcguire

  • Keywords JASMIN, VPN, puma, ssh, scp, sftp added
  • Platform set to JASMIN
Note: See TracTickets for help on using tickets.