Opened 2 years ago

Closed 2 years ago

#2224 closed help (fixed)

Problem for submitting the job

Reported by: jfgu Owned by: um_support
Component: UM Model Keywords:
Cc: Platform:
UM Version: <select version>

Description

Hello, I have a problem for submitting my standard job from PUMA. My suite number is u-an830. A previous job submitted using this suite has just successfully finished. I just changed several parameters of background mean flows. Then I tried rose suite-run —new and it failed with the error. Please see the attached file for the error information.
Could someone help me with this problem? Thank you very much!

Jian-Feng

Attachments (1)

submit problem-u-an830.png (110.4 KB) - added by jfgu 2 years ago.
sumbmitting error from PUMA

Download all attachments as: .zip

Change History (8)

Changed 2 years ago by jfgu

sumbmitting error from PUMA

comment:1 Changed 2 years ago by grenville

Jian-Feng

Is this still a problem?

Grenville

comment:2 Changed 2 years ago by jfgu

Dear Grenville,

Thank you for reply. Yes, this is still a problem. I have stuck here for days and no one else around me konws how to solve it. I am about to create a new ticket about this just now. Please could you help me with this ? It is really important.
The following is the information in log file:

[INFO] 2017-07-18T09:27:05+0100 cylc get-global-config -i [hosts][localhost]run\ directory
[INFO] 2017-07-18T09:27:06+0100 cylc get-global-config -i [hosts][localhost]work\ directory
[INFO] 2017-07-18T09:27:06+0100 Configuration: /home/jfgu/roses/u-an830/
[INFO] 2017-07-18T09:27:06+0100 file: rose-suite.conf
[INFO] 2017-07-18T09:27:06+0100 cylc —version
[INFO] 2017-07-18T09:27:06+0100 pgrep -f -u jfgu python.*/bin/cylc-(run|restart)(\ |\ .+\ )u-an830(\ |$)
[INFO] 2017-07-18T09:27:06+0100 pgrep -f -u jfgu python.*/bin/cylc-(run|restart)(\ |\ .+\ )u-an830(\ |$)
[INFO] 2017-07-18T09:27:06+0100 delete: /home/jfgu/cylc-run/u-an830/
[INFO] 2017-07-18T09:27:06+0100 cylc refresh —unregister
[INFO] 2017-07-18T09:27:07+0100 delete: /home/jfgu/.cylc/u-an830
[INFO] 2017-07-18T09:27:07+0100 create: /home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T09:27:07+0100 create: log.20170718T082707Z
[INFO] 2017-07-18T09:27:07+0100 symlink: log.20170718T082707Z ⇐ log
[INFO] 2017-07-18T09:27:07+0100 create: log/suite
[INFO] 2017-07-18T09:27:07+0100 create: log/rose-conf
[INFO] 2017-07-18T09:27:07+0100 svn info —non-interactive
[INFO] 2017-07-18T09:27:07+0100 svn status —non-interactive
[INFO] 2017-07-18T09:27:07+0100 svn diff —internal-diff —non-interactive
[INFO] 2017-07-18T09:27:07+0100 git describe
[INFO] 2017-07-18T09:27:07+0100 symlink: rose-conf/20170718T092707-run.conf ⇐ log/rose-suite-run.conf
[INFO] 2017-07-18T09:27:07+0100 symlink: rose-conf/20170718T092707-run.version ⇐ log/rose-suite-run.version
[INFO] 2017-07-18T09:27:07+0100 create: share
[INFO] 2017-07-18T09:27:07+0100 create: share/cycle
[INFO] 2017-07-18T09:27:07+0100 create: work
[INFO] 2017-07-18T09:27:07+0100 export CYLC_VERSION=6.11.4
[INFO] 2017-07-18T09:27:07+0100 export ROSE_ORIG_HOST=puma
[INFO] 2017-07-18T09:27:07+0100 export ROSE_VERSION=2016.11.1
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/suite-setup.rc
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/app
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/meta
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/Jinja2Filters
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/rose-suite.info
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/bin
[INFO] 2017-07-18T09:27:08+0100 create: bin
[INFO] 2017-07-18T09:27:08+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/bin/ bin
[INFO] 2017-07-18T09:27:08+0100 install: bin
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/bin
[INFO] 2017-07-18T09:27:08+0100 install: suite-setup.rc
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/suite-setup.rc
[INFO] 2017-07-18T09:27:08+0100 create: meta
[INFO] 2017-07-18T09:27:08+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/meta/ meta
[INFO] 2017-07-18T09:27:08+0100 install: meta
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/meta
[INFO] 2017-07-18T09:27:08+0100 install: rose-suite.info
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/rose-suite.info
[INFO] 2017-07-18T09:27:08+0100 create: Jinja2Filters
[INFO] 2017-07-18T09:27:08+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/Jinja2Filters/ Jinja2Filters
[INFO] 2017-07-18T09:27:08+0100 install: Jinja2Filters
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/Jinja2Filters
[INFO] 2017-07-18T09:27:08+0100 create: app
[INFO] 2017-07-18T09:27:08+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/app/ app
[INFO] 2017-07-18T09:27:08+0100 install: app
[INFO] 2017-07-18T09:27:08+0100 source: /home/jfgu/roses/u-an830/app
[INFO] 2017-07-18T09:27:08+0100 install: suite.rc
[INFO] 2017-07-18T09:27:08+0100 cylc get-directory u-an830
[INFO] 2017-07-18T09:27:09+0100 cylc refresh —unregister
[INFO] 2017-07-18T09:27:09+0100 cylc unregister u-an830
[INFO] 2017-07-18T09:27:10+0100 0 suite(s) unregistered.
[INFO] 2017-07-18T09:27:10+0100 cylc register u-an830 /home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T09:27:10+0100 REGISTER u-an830: /home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T09:27:10+0100 symlink: /home/jfgu/cylc-run/u-an830 ⇐ /home/jfgu/.cylc/u-an830
[INFO] 2017-07-18T09:27:10+0100 cylc validate -v —strict u-an830
[INFO] 2017-07-18T09:27:11+0100 Loading site/user config files
[INFO] 2017-07-18T09:27:11+0100 Reading file /home/fcm/cylc-6.11.4/conf/global.rc
[INFO] 2017-07-18T09:27:11+0100 Reading file /home/jfgu/cylc-run/u-an830/suite.rc
[INFO] 2017-07-18T09:27:11+0100 Processing with Jinja2
[INFO] 2017-07-18T09:27:11+0100 Writing file /home/jfgu/cylc-run/u-an830/suite.rc.processed
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T09:27:11+01 INFO - Expanding [runtime] namespace lists and parameters
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T09:27:11+01 INFO - Parsing the runtime namespace hierarchy
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T08:27:11Z INFO - Parsing [special tasks]
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T08:27:11Z INFO - Parsing the dependency graph
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T08:27:11Z INFO - Configuring internal queues
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T08:27:11Z INFO - Checking for defined tasks not used in the graph
[INFO] 2017-07-18T09:27:11+0100 2017-07-18T08:27:11Z INFO - Checking [visualization] node attributes
[INFO] 2017-07-18T09:27:11+0100 Instantiating tasks to check trigger expressions
[INFO] 2017-07-18T09:27:11+0100 + atmos_atmos.20000101T0000Z ok
[INFO] 2017-07-18T09:27:11+0100 + atmos_recon.20000101T0000Z ok
[INFO] 2017-07-18T09:27:11+0100 + fcm_make2.20000101T0000Z ok
[INFO] 2017-07-18T09:27:11+0100 + fcm_make.20000101T0000Z ok
[INFO] 2017-07-18T09:27:11+0100 Valid for cylc-6.11.4
[INFO] 2017-07-18T09:27:11+0100 WARNING: deprecated items were automatically upgraded in 'suite definition':
[INFO] 2017-07-18T09:27:11+0100 * (6.11.0) [cylc][event hooks] → [cylc][events] - value unchanged
[INFO] 2017-07-18T09:27:11+0100 * (6.11.0) [runtime][root][event hooks] → [runtime][root][events] - value unchanged
[INFO] 2017-07-18T09:27:11+0100 * (6.11.0) [runtime][XC30][job submission] → [runtime][XC30][job] - value unchanged
[INFO] 2017-07-18T09:27:11+0100 * (6.11.0) [runtime][LINUX][job submission] → [runtime][LINUX][job] - value unchanged
[INFO] 2017-07-18T09:27:11+0100 * (6.11.0) [runtime][XC30][job][method] → [runtime][XC30][job][batch system] - value unchanged
[INFO] 2017-07-18T09:27:11+0100 * (6.11.0) [runtime][LINUX][job][method] → [runtime][LINUX][job][batch system] - value unchanged
[INFO] 2017-07-18T09:27:11+0100 cylc get-config -ao -i [remote]owner -i [remote]host u-an830
[INFO] 2017-07-18T09:27:13+0100 ssh -oBatchMode=yes login.archer.ac.uk bash —login -c \'ROSE_VERSION=2016.11.1\ rose\ suite-run\ -v\ -v\ —name=u-an830\ —new\ —run=run\ —remote=uuid=1cf28e5e-baba-4ebc-9702-7b6caf6fabd3,root-dir=$DATADIR\'

Jian-Feng

comment:3 Changed 2 years ago by grenville

Jian-Feng

Try deleting cylc-run/u-an830 on puma and archer, then rerun.

Grenville

comment:4 Changed 2 years ago by jfgu

Hi Grenville,

Deleting cycl-run/u-an830 on puma and archer does not work. Still have problem submitting the job from PUMA. The same error information. Following is the information in the log file:

[INFO] 2017-07-18T12:02:37+0100 cylc get-global-config -i [hosts][localhost]run\ directory
[INFO] 2017-07-18T12:02:38+0100 cylc get-global-config -i [hosts][localhost]work\ directory
[INFO] 2017-07-18T12:02:38+0100 Configuration: /home/jfgu/roses/u-an830/
[INFO] 2017-07-18T12:02:38+0100 file: rose-suite.conf
[INFO] 2017-07-18T12:02:38+0100 cylc —version
[INFO] 2017-07-18T12:02:38+0100 pgrep -f -u jfgu python.*/bin/cylc-(run|restart)(\ |\ .+\ )u-an830(\ |$)
[INFO] 2017-07-18T12:02:38+0100 create: /home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T12:02:38+0100 create: log.20170718T110238Z
[INFO] 2017-07-18T12:02:38+0100 symlink: log.20170718T110238Z ⇐ log
[INFO] 2017-07-18T12:02:38+0100 create: log/suite
[INFO] 2017-07-18T12:02:38+0100 create: log/rose-conf
[INFO] 2017-07-18T12:02:38+0100 svn info —non-interactive
[INFO] 2017-07-18T12:02:38+0100 svn status —non-interactive
[INFO] 2017-07-18T12:02:38+0100 svn diff —internal-diff —non-interactive
[INFO] 2017-07-18T12:02:38+0100 git describe
[INFO] 2017-07-18T12:02:39+0100 symlink: rose-conf/20170718T120238-run.conf ⇐ log/rose-suite-run.conf
[INFO] 2017-07-18T12:02:39+0100 symlink: rose-conf/20170718T120238-run.version ⇐ log/rose-suite-run.version
[INFO] 2017-07-18T12:02:39+0100 create: share
[INFO] 2017-07-18T12:02:39+0100 create: share/cycle
[INFO] 2017-07-18T12:02:39+0100 create: work
[INFO] 2017-07-18T12:02:39+0100 export CYLC_VERSION=6.11.4
[INFO] 2017-07-18T12:02:39+0100 export ROSE_ORIG_HOST=puma
[INFO] 2017-07-18T12:02:39+0100 export ROSE_VERSION=2016.11.1
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/suite-setup.rc
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/app
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/meta
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/Jinja2Filters
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/rose-suite.info
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/bin
[INFO] 2017-07-18T12:02:39+0100 install: suite-setup.rc
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/suite-setup.rc
[INFO] 2017-07-18T12:02:39+0100 install: rose-suite.info
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/rose-suite.info
[INFO] 2017-07-18T12:02:39+0100 create: bin
[INFO] 2017-07-18T12:02:39+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/bin/ bin
[INFO] 2017-07-18T12:02:39+0100 install: bin
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/bin
[INFO] 2017-07-18T12:02:39+0100 create: meta
[INFO] 2017-07-18T12:02:39+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/meta/ meta
[INFO] 2017-07-18T12:02:39+0100 install: meta
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/meta
[INFO] 2017-07-18T12:02:39+0100 create: Jinja2Filters
[INFO] 2017-07-18T12:02:39+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/Jinja2Filters/ Jinja2Filters
[INFO] 2017-07-18T12:02:39+0100 install: Jinja2Filters
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/Jinja2Filters
[INFO] 2017-07-18T12:02:39+0100 create: app
[INFO] 2017-07-18T12:02:39+0100 rsync -a —exclude=.* —timeout=1800 —rsh=ssh\ -oBatchMode=yes —checksum /home/jfgu/roses/u-an830/app/ app
[INFO] 2017-07-18T12:02:39+0100 install: app
[INFO] 2017-07-18T12:02:39+0100 source: /home/jfgu/roses/u-an830/app
[INFO] 2017-07-18T12:02:39+0100 install: suite.rc
[INFO] 2017-07-18T12:02:39+0100 cylc get-directory u-an830
[INFO] 2017-07-18T12:02:40+0100 cylc refresh —unregister
[INFO] 2017-07-18T12:02:41+0100 cylc unregister u-an830
[INFO] 2017-07-18T12:02:41+0100 UNREGISTER u-an830:/home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T12:02:41+0100 1 suite(s) unregistered.
[INFO] 2017-07-18T12:02:41+0100 cylc register u-an830 /home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T12:02:42+0100 REGISTER u-an830: /home/jfgu/cylc-run/u-an830
[INFO] 2017-07-18T12:02:42+0100 cylc validate -v —strict u-an830
[INFO] 2017-07-18T12:02:43+0100 Loading site/user config files
[INFO] 2017-07-18T12:02:43+0100 Reading file /home/fcm/cylc-6.11.4/conf/global.rc
[INFO] 2017-07-18T12:02:43+0100 Reading file /home/jfgu/cylc-run/u-an830/suite.rc
[INFO] 2017-07-18T12:02:43+0100 Processing with Jinja2
[INFO] 2017-07-18T12:02:43+0100 Writing file /home/jfgu/cylc-run/u-an830/suite.rc.processed
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T12:02:43+01 INFO - Expanding [runtime] namespace lists and parameters
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T12:02:43+01 INFO - Parsing the runtime namespace hierarchy
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T11:02:43Z INFO - Parsing [special tasks]
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T11:02:43Z INFO - Parsing the dependency graph
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T11:02:43Z INFO - Configuring internal queues
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T11:02:43Z INFO - Checking for defined tasks not used in the graph
[INFO] 2017-07-18T12:02:43+0100 2017-07-18T11:02:43Z INFO - Checking [visualization] node attributes
[INFO] 2017-07-18T12:02:43+0100 Instantiating tasks to check trigger expressions
[INFO] 2017-07-18T12:02:43+0100 + atmos_atmos.20000101T0000Z ok
[INFO] 2017-07-18T12:02:43+0100 + atmos_recon.20000101T0000Z ok
[INFO] 2017-07-18T12:02:43+0100 + fcm_make2.20000101T0000Z ok
[INFO] 2017-07-18T12:02:43+0100 + fcm_make.20000101T0000Z ok
[INFO] 2017-07-18T12:02:43+0100 Valid for cylc-6.11.4
[INFO] 2017-07-18T12:02:43+0100 WARNING: deprecated items were automatically upgraded in 'suite definition':
[INFO] 2017-07-18T12:02:43+0100 * (6.11.0) [cylc][event hooks] → [cylc][events] - value unchanged
[INFO] 2017-07-18T12:02:43+0100 * (6.11.0) [runtime][root][event hooks] → [runtime][root][events] - value unchanged
[INFO] 2017-07-18T12:02:43+0100 * (6.11.0) [runtime][XC30][job submission] → [runtime][XC30][job] - value unchanged
[INFO] 2017-07-18T12:02:43+0100 * (6.11.0) [runtime][LINUX][job submission] → [runtime][LINUX][job] - value unchanged
[INFO] 2017-07-18T12:02:43+0100 * (6.11.0) [runtime][XC30][job][method] → [runtime][XC30][job][batch system] - value unchanged
[INFO] 2017-07-18T12:02:43+0100 * (6.11.0) [runtime][LINUX][job][method] → [runtime][LINUX][job][batch system] - value unchanged
[INFO] 2017-07-18T12:02:43+0100 cylc get-config -ao -i [remote]owner -i [remote]host u-an830
[INFO] 2017-07-18T12:02:44+0100 ssh -oBatchMode=yes login.archer.ac.uk bash —login -c \'ROSE_VERSION=2016.11.1\ rose\ suite-run\ -v\ -v\ —name=u-an830\ —run=run\ —remote=uuid=96907b0e-3815-46a7-a6fe-903084183878,root-dir=$DATADIR\'

Jian-Feng

comment:5 Changed 2 years ago by grenville

You appear not to have deleted /home/n02/n02/jfgu/cylc-run/u-an830 or /work/n02/n02/jfgu/cylc-run/u-an830

comment:6 Changed 2 years ago by jfgu

Dear Grenville,

It works now. Thank you very much for your help! You can close the ticket now~

Jian-Feng

comment:7 Changed 2 years ago by grenville

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.