Opened 8 years ago
Closed 7 years ago
#1105 closed help (answered)
Segmentation fault when using the PC2 cloud scheme
Reported by: | Emma_Turner | Owned by: | um_support |
---|---|---|---|
Component: | UM Model | Keywords: | PC2, HadGEM2-A |
Cc: | damian.wilson@… | Platform: | HECToR |
UM Version: | 6.6.3 |
Description
Hello,
I am trying to run a previously working job but with the new PC2 cloud scheme implemented. I followed the instructions in the documentation that show how to do this and have included a difference report to show the changes made at the bottom of this ticket. The new job is xihte, old is xihte. It starts running but crashes and produces a blank first time step. The .leave file shows the error:
_pmiu_daemon(SIGCHLD): [NID 02386] [c5-1c1s6n0] [Tue Jul 23 16:25:45 2013] PE RANK 27 exit signal Segmentation fault
Trying to attach xihte000.xihte.d13204.t145458.leave to this ticket.
Any help would be appreciated.
Thanks
Emma
Difference in window atmos_Science_Section_LSRain
→ Model Selection
→ Atmosphere
→ Scientific Parameters and Sections
→ Section by section choices
→ Section 4: Large Scale Precipitation
Radio button: Choose version
Job xihtd: Entry is set to '<3C> Improved microphysics scheme'
Job xihte: Entry is set to '<3D> Advanced microphysics scheme (recommended), compatible with PC2'
Difference in window atmos_Science_Section_Conv
→ Model Selection
→ Atmosphere
→ Scientific Parameters and Sections
→ Section by section choices
→ Section 5: Convection
Entry box: Defining anvil factor
Job xihtd: Entry is set to '3.0000'
Job xihte: Entry is set to '0.0000'
Check box: Use a phase change temperature in the plume other than 0 deg C
Job xihtd: Entry is set to 'OFF'
Job xihte: Entry is set to 'ON'
Entry box: Defining tower factor
Job xihtd: Entry is set to '0.2500'
Job xihte: Entry is set to '0.0000'
Entry box: Estimate saturation specific humidity at this phase change T / kg kg-1 (qstice). See Help.
Job xihtd: Entry is inactive
Job xihte: Entry is set to '3.5000e-03'
Entry box: Specify phase change temperature / K (Tice)
Job xihtd: Entry is inactive
Job xihte: Entry is set to '263.1500'
Difference in window atmos_Science_Section_Cloud
→ Model Selection
→ Atmosphere
→ Scientific Parameters and Sections
→ Section by section choices
→ Section 9: Large Scale Cloud
Hidden variable: Method of cloud area parametrization
Job xihtd: Variable is set to '1'
Job xihte: Entry is inactive
Check box: Including cloud area parametrization (Gen2 Rad only)
Job xihtd: Entry is set to 'ON'
Job xihte: Entry is set to 'OFF'
Check box: Use prognostic cloud scheme PC2?
Job xihtd: Entry is set to 'OFF'
Job xihte: Entry is set to 'ON'
Entry box: Enter value of cloud erosion / s-1
Job xihtd: Entry is inactive
Job xihte: Entry is set to '-2.25e-05'
Attachments (1)
Change History (14)
Changed 8 years ago by Emma_Turner
comment:1 Changed 8 years ago by willie
- Cc damian.wilson@… added
- Keywords PC2, HadGEM2-A added
comment:2 Changed 8 years ago by Emma_Turner
Hi Willie,
I spoke with Cyril Morcrette of cloud parameterisation before running the scheme, he advised the changes I made. Happy to talk with Damian about the other physics schemes if there are other bits that need to be changed. Thanks Damian!
Emma
comment:3 Changed 8 years ago by willie
- Owner changed from um_support to willie
- Status changed from new to accepted
Hi Emma,
We need to get some more debug info to find out what's going on:
- In Output options, switch on subroutine timer diagnostics
- In compiler options for the model, select debug
- add a user machine over ride: this is a file (on PUMA) containing one line
%fflags_opt_debug -g
- In Atmos > scientific sections > section by section > section 13, select DIAG_PRN and tick flush buffer if run fails.
Then delete any file /work/d43/d43-geos-climate/eturner/um/xihte/M/core and rebuild and run the job again.
Regards,
Willie
comment:4 Changed 8 years ago by Emma_Turner
Hi Willie,
The job has finished running with the extra options.
Thaks
Emma
comment:5 Changed 8 years ago by willie
Could you let me have read permission on the core file please.
Willie
comment:6 Changed 8 years ago by Emma_Turner
That file has read permissions but I think from looking back at emails regarding giving project access to yourself and grenvill that you have to join the d43 project if you haven't, then you read and write in the directory.
Let me know if there are any further problems.
Thanks
Emma
comment:7 Changed 7 years ago by willie
Hi Emma,
The segmentation fault occurs in Atm_step at the first time step. It is trying to allocate some memory in
! ---------------------------------------------------------------------- ! Section 6.0 Calculate u, v, w, theta, q, qcl, qcf at new time level. ! Extrapolate u, v, w, to time level n+1.5 for use in ! advection step on next timestep. ! ----------------------------------------------------------------------
This is very early on, and the error has probably occurred before this point. This suggests that the set up is at fault. I am afraid I am unable to go further than this.
I hope that helps,
Regards,
Willie
comment:8 Changed 7 years ago by Emma_Turner
Hi Willie,
I've been speaking with Cyril Morcrette and we think that we need to tell the UM that we are using extra prognostics for the PC2 scheme in the initial dump. Therefore I think I need to add an extra STASHmaster file. I'm just reading through how to create these.. Can I have write access to the /home/umui/hadgem2/userstash directory so I can put it in here?
Thanks
Emma
comment:9 Changed 7 years ago by Emma_Turner
Hi again,
I had a quick look at the help desk tickets and wondered if such a user STASHmaster file exists for these extra PC2 prognostics? These would be the cloud variables qcl, qcf, CFL, CFF, and BCF. This ticket http://cms.ncas.ac.uk/ticket/352 seems relevant but it relates to version 7.1. I wonder if an equivalent exists for version 6.6.3? Creating it myself does not look straight forward!
Thanks
Emma
comment:10 Changed 7 years ago by willie
Hi Emma,
You can create local user STASH master files under your own account on PUMA. You can get the basics by copying entries you need from $UMDIR/vn8.2/ctldata/STASHmaster/STASHmaster_A, say. It is possible that the 7.1 version could suffice.
regards,
Willie
comment:11 Changed 7 years ago by Emma_Turner
Hi Willie,
I have followed the instructions to create and add a user STASHmaster file (USMF) containing new prognostics, a copy of STASHmaster_PC2 is at the bottom of this comments. I initialised all fields to zero by specifying the code '3' in the Model Selection - Atmosphere - STASH - Initialisation of Prognostics window and added the file at the local location in User STASHmaster files, Diags, Progs & Ancils at ~/STASHmaster_PC2. I think they added because they appear in the PRESM_A file after the run. The run still failed with the same segmentation fault, can you check I did this USMF step correctly?
Thanks
Emma
H1| SUBMODEL_NUMBER=1
H2| SUBMODEL_NAME=ATMOS
H3| UM_VERSION=6.6.3
#
#|Model |Sectn | Item |Name |
#|Space |Point | Time | Grid |LevelT|LevelF|LevelL|PseudT|PseudF|PseudL|LevCom?|
#| Option Codes | Version Mask | Halo |
#|DataT |DumpP | PC1 PC2 PC3 PC4 PC5 PC6 PC7 PC8 PC9 PCA |
#|Rotate| PPF | USER | LBVC | BLEV | TLEV |RBLEVV| CFLL | CFFF |
#
#===============================================================================
#
1| 1 | 0 | 12 |QCF AFTER TIMESTEP |
2| 2 | 0 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000001 | 2 |
4| 1 | 2 | -24 -24 -24 -24 -99 30 -99 -99 -99 -99 |
5| 0 | 78 | 0 | 65 | 0 | 0 | 0 | 0 | 118 |
#
1| 1 | 0 | 254 |QCL AFTER TIMESTEP |
2| 2 | 0 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000001 | 2 |
4| 1 | 2 | -24 -24 -24 -24 -99 30 -99 -99 -99 -99 |
5| 0 | 79 | 0 | 65 | 0 | 0 | 0 | 0 | 117 |
#
1| 1 | 0 | 265 |AREA CLOUD FRACTION IN EACH LAYER |
2| 2 | 0 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000001 | 3 |
4| 1 | 2 | -6 -6 -6 -6 -6 16 -99 -99 -99 -99 |
5| 0 | 1729 | 0 | 65 | 0 | 0 | 0 | 0 | 0 |
#
1| 1 | 0 | 266 |BULK CLOUD FRACTION IN EACH LAYER |
2| 2 | 0 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000001 | 2 |
4| 1 | 2 | -6 -6 -6 -6 -6 16 -99 -99 -99 -99 |
5| 0 | 220 | 0 | 65 | 0 | 0 | 0 | 0 | 79 |
#
1| 1 | 0 | 267 |LIQUID CLOUD FRACTION IN EACH LAYER |
2| 2 | 0 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000001 | 2 |
4| 1 | 2 | -6 -6 -6 -6 -6 16 -99 -99 -99 -99 |
5| 0 | 1425 | 0 | 65 | 0 | 0 | 0 | 0 | 0 |
#
1| 1 | 0 | 268 |FROZEN CLOUD FRACTION IN EACH LAYER |
2| 2 | 0 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000001 | 2 |
4| 1 | 2 | -6 -6 -6 -6 -6 16 -99 -99 -99 -99 |
5| 0 | 1426 | 0 | 65 | 0 | 0 | 0 | 0 | 0 |
#
#===============================================================================
#
# Section 90 Reserved for post-processed derived fields
# 1| 1 | 90 | 201 |Reserved for Thickness fields for FS |
#
#===============================================================================
#
1| -1 | -1 | -1 |END OF FILE MARK |
2| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
3| 000000000000000000000000000000 | 00000000000000000000 | 0 |
4| 0 | 0 | -99 -99 -99 -99 -30 -99 -99 -99 -99 -99 |
5| 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
#
comment:12 Changed 7 years ago by willie
- Owner changed from willie to um_support
- Status changed from accepted to assigned
Hi Emma,
It seems OK, but the items that you've introduces are already present in the 6.6.3 STASH master file. Perhaps the problem is elsewhere?
I hope that helps.
regards
Willie
comment:13 Changed 7 years ago by willie
- Resolution set to answered
- Status changed from assigned to closed
Hi Emma,
It might be helpful to discuss this with Damian Wilson at the Met Office (cc'd).
I hope that helps.
Regards,
Willie