Opened 5 weeks ago

Last modified 5 weeks ago

#2938 accepted error

Soil tiling in offline simulations

Reported by: mtodt Owned by: pmcguire
Component: JULES Keywords: JULES soil tiling
Cc: pmcguire Platform: JASMIN
UM Version:

Description

Hi Patrick

I'm trying to run WFDEI-driven offline simulations with soil tiling turned on, by including the following flags to the JULES soil namelist.

[namelist:jules_soil]

l_broadcast_ancils=.true.

l_tile_soil=.true

However, JULES fails almost immediately, and the error message is beyond me, to be honest.

* * * glibc detected * * * /home/users/mtodt/cylc-run/u-bj046/share/fcm_make/build/bin/jules.exe: corrupted double-linked list: 0x0000000005cb0230 * * *

MPI Application rank 0 killed before MPI_Finalize() with signal 6
forrtl: error (78): process killed (SIGTERM)

libmpi.so.1 00007F0C9CC6B0A2 Unknown Unknown Unknown
jules.exe 00000000004836B4 parallel_mod_mp_g 552 parallel_mod.F90
jules.exe 00000000004836B4 parallel_mod_mp_g 552 parallel_mod.F90
jules.exe 0000000000590BDE dump_mod_mp_write 3179 dump_mod.F90
jules.exe 0000000000590BDE dump_mod_mp_write 3179 dump_mod.F90
jules.exe 000000000040F701 init_mod_mp_init_ 148 init.F90
jules.exe 000000000040F701 init_mod_mp_init_ 148 init.F90
jules.exe 0000000000405B87 MAIN_ 86 jules.F90
jules.exe 0000000000405B87 MAIN_ 86 jules.F90

[FAIL] rose-jules-run <<'_STDIN_'
[FAIL]
[FAIL] '_STDIN_' # return-code=255
2019-06-19T12:33:28Z CRITICAL - failed/EXIT

Running the same simulation without soil tiling works. Have you experienced this error message previously or any experience with soil tiling in JULES? (Log files .out and .err are attached.) Many thanks in advance!

Cheers
Markus

Attachments (2)

job.err (14.9 KB) - added by mtodt 5 weeks ago.
job.out (341.3 KB) - added by mtodt 5 weeks ago.

Download all attachments as: .zip

Change History (10)

Changed 5 weeks ago by mtodt

Changed 5 weeks ago by mtodt

comment:1 Changed 5 weeks ago by pmcguire

  • Status changed from new to accepted

comment:2 Changed 5 weeks ago by pmcguire

Hi Markus
No, I haven't personally seen that error before.
Did you also try with l_broadcast_ancils set to False and l_tile_soil set to True?
Patrick

comment:3 Changed 5 weeks ago by pmcguire

Hi Markus:
Your job.out file says that it crashes after this print statement:
{MPI Task 0} [INFO] write_dump: t_soil_soilt
This means that it crashes probably somewhere in this code:
/group_workspaces/jasmin2/jules/pmcguire/jules_build/jules-vn4.9_positiverain/src/io/dump/write_dump.inc
where it has these lines:

   CASE ( 't_soil_soilt' )
        DO m=1,nsoilt
          DO n = 1,sm_levels
            CALL gather_land_field(t_soil_soilt(:,m,n), global_data_3d(:,m,n))
          END DO
        END DO

So I would guess there's either a bug in gather_land_field( ) or the input or output arrays are not set up properly.
Patrick

comment:4 Changed 5 weeks ago by mtodt

l_broadcast_ancils is necessary for soil tiles, the simulation fails without it being set to true.

comment:5 Changed 5 weeks ago by pmcguire

Do you have documentation for soil tiles?
Have you tried setting l_broadcast_soilt_io or l_broadcast_soilt to True?
Can you give me permissions to read your ~mtodt\roses and ~mtodt\cylc-run directories?
Patrick

comment:6 Changed 5 weeks ago by mtodt

Thanks for your help! There's no documentation of soil tiling in the user guide, as far as I'm aware. I saw it being mentioned in a .out log file and then looked up soil tiling in the source code. The two flags are used in /src/control/shared/jules_soil_mod.F90.

I think you should have access to those directories.

Cheers
Markus

comment:7 Changed 5 weeks ago by pmcguire

No I don't have access to those directories.
You'll probably need also to set the permissions for /home/users/mtodt as well, in order to match those of /home/users/pmcguire. You can make any subdirectories of your home directory that you want to not be world-readable.

comment:8 Changed 5 weeks ago by mtodt

Oh, I see. Changed that now, sorry!

Note: See TracTickets for help on using tickets.