Scheduled Downtime
On Friday 21 April 2023 @ 5pm MT, this website will be down for maintenance and expected to return online the morning of 24 April 2023 at the latest

SIGTERM when run WRF urban with 250m resolution

This post was from a previous version of the WRF&MPAS-A Support Forum. New replies have been disabled and if you have follow up questions related to this post, then please start a new thread from the forum home page.

htan2013

Member
Dear all,

I tried to run a simulation over Chicago metropolitan area with 3 domains, D01: 2.25km, D02: 750m, and D03: 250m resolution.
The version is WRF4.3.1 and the BEP+BEM was used for D03.

My namelist is:

&time_control
run_days = 7,
run_hours = 0,
run_minutes = 0,
run_seconds = 0,
start_year = 2009, 2009, 2009,
start_month = 04, 04, 04,
start_day = 01, 01, 01,
start_hour = 00, 00, 00,
end_year = 2009, 2009, 2009,
end_month = 04, 04, 04,
end_day = 07, 07, 07,
end_hour = 00, 00, 00,
interval_seconds = 3600,
input_from_file = .true.,.true.,.true.,
history_interval = 60, 60, 60,
frames_per_outfile = 1, 1, 1,
restart = .false.,
restart_interval = 60,
io_form_history = 2
io_form_restart = 2
io_form_input = 2
io_form_boundary = 2
debug_level = 0
/

&domains
eta_levels= 1., 0.998743415, 0.99748677,
0.996230185, 0.994973600, 0.993716955, 0.992334723,
0.990814209, 0.989141703, 0.987301886, 0.985278130,
0.983051956, 0.980603218, 0.977909565, 0.974946558,
0.971687257, 0.968101978, 0.964158237, 0.959820092,
0.955048144, 0.949799001, 0.944024920, 0.937673509,
0.930686891, 0.923001587, 0.914547801, 0.905248582,
0.895019472, 0.883767486, 0.871390283, 0.857775331,
0.842798889, 0.826324821, 0.808203340, 0.788269699,
0.766342700, 0.742223024, 0.715691328, 0.686506450,
0.654403150, 0.619089544, 0.580244482, 0.537514985,
0.490512520, 0.438809812, 0.381936818, 0.319376528,
0.250560224, 0.174862280, 0.0915945247,0.0000,
time_step = 10,
time_step_fract_num = 0,
time_step_fract_den = 1,
max_dom = 3,
e_we = 802, 763, 796,
e_sn = 629, 835, 1447,
e_vert = 51, 51, 51,
p_top_requested = 5000,
num_metgrid_levels = 38,
num_metgrid_soil_levels = 4,
dx = 2250,
dy = 2250,
grid_id = 1, 2, 3,
parent_id = 0, 1, 2,
i_parent_start = 1, 185, 185,
j_parent_start = 1, 63, 97,
parent_grid_ratio = 1, 3, 3,
parent_time_step_ratio = 1, 3, 3,
feedback = 1,
smooth_option = 0
/

&physics
mp_physics = 3, 3, 3,
cu_physics = 0, 0, 0,
ra_lw_physics = 4, 4, 4,
ra_sw_physics = 2, 2, 2,
bl_pbl_physics = 2, 2, 2,
sf_sfclay_physics = 2, 2, 2,
sf_surface_physics = 2, 2, 2,
radt = 5, 5, 5,
bldt = 0, 0, 0,
cudt = 0, 0, 0,
icloud = 1,
num_land_cat = 40,
use_wudapt_lcz = 1,
sf_urban_physics = 0, 0, 3,
fractional_seaice = 1,
/

&fdda
/

&dynamics
hybrid_opt = 2,
w_damping = 0,
diff_opt = 1, 1, 1,
km_opt = 4, 4, 4,
diff_6th_opt = 0, 0, 0,
diff_6th_factor = 0.12, 0.12, 0.12,
base_temp = 290.
damp_opt = 3,
zdamp = 5000., 5000., 5000.,
dampcoef = 0.2, 0.2, 0.2,
khdif = 0, 0, 0,
kvdif = 0, 0, 0,
non_hydrostatic = .true., .true., .true.,
moist_adv_opt = 1, 1, 1,
scalar_adv_opt = 1, 1, 1,
gwd_opt = 0, 0, 0,
/

&bdy_control
spec_bdy_width = 5,
specified = .true.
/

&grib2
/

&namelist_quilt
nio_tasks_per_group = 0,
nio_groups = 1,
/


I have customized eta_levels since I need to add more levels below 50m. Those numbers are tested by study (10.1002/joc.3398).
The error that I ran into is:

forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
wrf.exe 00000000238718C4 for__signal_handl Unknown Unknown
libpthread-2.26.s 00002AAAAE4332D0 Unknown Unknown Unknown
libugni.so.0.6.0 00002AAAB2565E08 Unknown Unknown Unknown
libmpich_intel.so 00002AAAAD3CCEE9 Unknown Unknown Unknown
libmpich_intel.so 00002AAAAD3CD9FA MPID_nem_gni_poll Unknown Unknown
libmpich_intel.so 00002AAAAD3AB776 MPIDI_CH3I_Progre Unknown Unknown
libmpich_intel.so 00002AAAAD2B5435 MPIR_Wait_impl Unknown Unknown
libmpich_intel.so 00002AAAAD2B5908 MPI_Wait Unknown Unknown
wrf.exe 000000002376DCE5 Unknown Unknown Unknown
wrf.exe 0000000021381383 Unknown Unknown Unknown
wrf.exe 0000000021D85DE7 Unknown Unknown Unknown
wrf.exe 00000000212AC8D6 Unknown Unknown Unknown
wrf.exe 000000002101F59C Unknown Unknown Unknown
wrf.exe 0000000020183293 Unknown Unknown Unknown
wrf.exe 0000000020018F34 Unknown Unknown Unknown
wrf.exe 0000000020018EDE Unknown Unknown Unknown
wrf.exe 0000000020018E52 Unknown Unknown Unknown
libc-2.26.so 00002AAAAE66334A __libc_start_main Unknown Unknown
wrf.exe 0000000020018D6A Unknown Unknown Unknown

I have attached my rsl files and namelist.input.
I am aware that my resolution is high, I have tried adding more nodes to avoid memory issues (240 nodes with 85GB mem on each node).
However, the model still crashed. The model is able to run without D02 and D03. Hope anyone can give me some suggestions.

Best regards,
Haochen
 

Attachments

  • namelist.input.txt
    4.7 KB · Views: 22
  • rsl.error.0012.txt
    115.4 KB · Views: 19
  • rsl.error.0013.txt
    128.8 KB · Views: 16
  • namelist.wps
    848 bytes · Views: 24
Hi Haochen,
Does this run without errors if you turn OFF urban physics? In the meantime, you can also take a look at this FAQ to see if it's helpful in tracking down the issue causing the segmentation fault.
 
Top