Scheduled Downtime
On Friday 21 April 2023 @ 5pm MT, this website will be down for maintenance and expected to return online the morning of 24 April 2023 at the latest

Tile Strategy is not specified( wrf.exe)

This post was from a previous version of the WRF&MPAS-A Support Forum. New replies have been disabled and if you have follow up questions related to this post, then please start a new thread from the forum home page.

T

tanghao

New member
Dear all
I got the wrfbdy and wrfinput files by run real.exe. But meet the err when run wrf.exe.

I try to set the time_step to 27 in namelist.input file , that does not work

Please give me some suggestion. rsl.err.0000 and namelist.input were attached

Thanks

******* rsl.err.0000 *********************

taskid: 0 hostname: node1
module_io_quilt_old.F 2931 F
Quilting with 1 groups of 0 I/O tasks.
Ntasks in X 1, ntasks in Y 1
WRF V4.0 MODEL
*************************************
Parent domain
ids,ide,jds,jde 1 150 1 102
ims,ime,jms,jme -4 155 -4 107
ips,ipe,jps,jpe 1 150 1 102
*************************************
DYNAMICS OPTION: Eulerian Mass Coordinate
alloc_space_field: domain 1, 379320484 bytes allocated
med_initialdata_input: calling input_input
Input data is acceptable to use: wrfinput_d01
Timing for processing wrfinput file (stream 0) for domain 1: 0.11737 elapsed seconds
Max map factor in domain 1 = 1.01. Scale the dt in the model accordingly.
INPUT LandUse = "MODIFIED_IGBP_MODIS_NOAH"
LANDUSE TYPE = "MODIFIED_IGBP_MODIS_NOAH" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 17 SNOW CATEGORY = 15
INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
*************************************
Nesting domain
ids,ide,jds,jde 1 235 1 160
ims,ime,jms,jme -4 240 -4 165
ips,ipe,jps,jpe 1 235 1 160
INTERMEDIATE domain
ids,ide,jds,jde 38 121 26 84
ims,ime,jms,jme 33 126 21 89
ips,ipe,jps,jpe 36 123 24 86
*************************************
d01 2018-03-30_00:00:00 alloc_space_field: domain 2, 38319288 bytes allocated
d01 2018-03-30_00:00:00 alloc_space_field: domain 2, 872403204 bytes allocated
d01 2018-03-30_00:00:00 *** Initializing nest domain # 2 from an input file. ***
d01 2018-03-30_00:00:00 med_initialdata_input: calling input_input
d01 2018-03-30_00:00:00 Input data is acceptable to use: wrfinput_d02
Timing for processing wrfinput file (stream 0) for domain 2: 0.29442 elapsed seconds
INPUT LandUse = "MODIFIED_IGBP_MODIS_NOAH"
LANDUSE TYPE = "MODIFIED_IGBP_MODIS_NOAH" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 17 SNOW CATEGORY = 15
INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
INPUT LandUse = "MODIFIED_IGBP_MODIS_NOAH"
LANDUSE TYPE = "MODIFIED_IGBP_MODIS_NOAH" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 17 SNOW CATEGORY = 15
INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
Max map factor in domain 1 = 1.01. Scale the dt in the model accordingly.
INPUT LandUse = "MODIFIED_IGBP_MODIS_NOAH"
LANDUSE TYPE = "MODIFIED_IGBP_MODIS_NOAH" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 17 SNOW CATEGORY = 15
INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
Timing for Writing wrfout_d01_2018-03-30_00:00:00 for domain 1: 0.43098 elapsed seconds
d01 2018-03-30_00:00:00 Input data is acceptable to use: wrfbdy_d01
Timing for processing lateral boundary for domain 1: 0.01533 elapsed seconds
Tile Strategy is not specified. Assuming 1D-Y
WRF TILE 1 IS 1 IE 150 JS 1 JE 102
WRF NUMBER OF TILES = 1
Fatal error in MPI_Allreduce:
Invalid MPI_Op, error stack:
MPI_Allreduce(886)..........: MPI_Allreduce(sbuf=0x341f870, rbuf=0x341f890, count=1, MPI_2INTEGER, MPI_MINLOC, comm=0xc4000000) failed
MPIR_MINLOC_check_dtype(215): MPI_Op MPI_MINLOC operation not defined for this datatype



******** namelist.input ****************

&time_control
run_days = 2,
run_hours = 12,
run_minutes = 0,
run_seconds = 0,
start_year = 2018, 2018, 2018,
start_month = 03, 03, 03,
start_day = 30, 30, 30,
start_hour = 00, 00, 00,
start_minute = 00, 00, 00,
start_second = 00, 00, 00,
end_year = 2018, 2018, 2018,
end_month = 04, 04, 04,
end_day = 01, 01, 01,
end_hour = 12, 12, 12,
end_minute = 00, 00, 00,
end_second = 00, 00, 00,
interval_seconds = 21600,
input_from_file = .true., .true., .true.,
history_interval = 60, 60, 60,
frames_per_outfile = 1000, 1000, 1000,
restart = .false.,
restart_interval = 5000,
io_form_history = 2,
io_form_restart = 2,
io_form_input = 2,
io_form_boundary = 2,
debug_level = 0,
/

&domains
eta_levels = 1.000, 0.9977, 0.9955, 0.9932, 0.9909,
0.9887, 0.9864, 0.9842, 0.9819, 0.9797,
0.9774, 0.9752, 0.9723, 0.9687, 0.964,
0.9578, 0.9497, 0.9391, 0.9255, 0.9079,
0.8857, 0.8583, 0.825, 0.7857, 0.7407,
0.6904, 0.6358, 0.5779, 0.5178, 0.4566,
0.3952, 0.3342, 0.2742, 0.2156, 0.1587,
0.1037, 0.0507, 0.000
time_step =162,
time_step_fract_num = 0,
time_step_fract_den = 1,
max_dom = 3,
e_we = 150, 235, 346,
e_sn = 102, 160, 265,
e_vert = 38,38,38,
p_top_requested = 48357.3
num_metgrid_levels = 32,
num_metgrid_soil_levels = 4,
dx = 27000, 9000, 3000,
dy = 27000, 9000, 3000,
grid_id = 1, 2, 3,
parent_id = 1, 1, 2,
i_parent_start = 1, 40, 78,
j_parent_start = 1, 28, 38,
parent_grid_ratio = 1, 3, 3,
parent_time_step_ratio = 1, 3, 3,
feedback = 1,
smooth_option = 0,
/

&physics
mp_physics = 3, 3, 3,
ra_lw_physics = 1, 1, 1,
ra_sw_physics = 1, 1, 1,
radt = 30, 30, 30,
sf_sfclay_physics = 1, 1, 1,
sf_surface_physics = 2, 2, 2,
bl_pbl_physics = 1, 1, 1,
bldt = 0, 0, 0,
cu_physics = 1, 1, 0,
cudt = 5, 5, 5,
isfflx = 1,
ifsnow = 0,
icloud = 1,
surface_input_source = 1,
num_soil_layers = 4,
sf_urban_physics = 0, 0, 0,
maxiens = 1,
maxens = 3,
maxens2 = 3,
maxens3 = 16,
ensdim = 144,
/

&fdda
/

&dynamics
w_damping = 0,
diff_opt = 1,
km_opt = 4,
diff_6th_opt = 0, 0, 0,
diff_6th_factor = 0.12, 0.12, 0.12,
base_temp = 290.,
damp_opt = 0,
zdamp = 5000., 5000., 5000.,
dampcoef = 0.2, 0.2, 0.2,
khdif = 0, 0, 0,
kvdif = 0, 0, 0,
non_hydrostatic = .true., .true., .true.,
moist_adv_opt = 1, 1, 1,
scalar_adv_opt = 1, 1, 1,
/

&bdy_control
spec_bdy_width = 5,
spec_zone = 1,
relax_zone = 4,
specified = .true., .false., .false.,
nested = .false., .true., .true.,
/

&grib2
/

&namelist_quilt
nio_tasks_per_group = 0,
nio_groups = 1,
/
 

Attachments

  • namelist.input
    4.4 KB · Views: 66
Can you set p_top= 5000, then try again?
I suppose this is a real data case. Please let me know if I am wrong.
 
Hi...

I thought I was the only person who had problems with bizarre crashes of WRF and friends. :)

Things to consider:

Look at *ALL* rsl.* files. Maybe one has a more useful complaint.

Does this happen all attempts? Is each run using a different node group? There is always
the possibility of a bad node.

Are you building with Intel 17.x or Intel 18.x compilers? If so, they sometimes generate badly
optimized code that causes early crashes. Try a lower optimization level on the build.

MPI has environmental variables that control how MPI runs. Sometimes, the default values
are insufficient for all problem sizes. Check with your System's people or check the man page
for your MPI implementation to see things to try. Unfortunately, MPI implementations are all
different.

Good luck.
 
Ming Chen said:
Can you set p_top= 5000, then try again?
I suppose this is a real data case. Please let me know if I am wrong.
Click to expand...

Thank you for reply. I try to set
p_top_requested = 5000.0 at line 46 of namelist.input file,and run real.exe and wrf.exe again , but the find the same error.

My namelist.input looks like this

&time_control
run_days = 2,
run_hours = 12,
run_minutes = 0,
run_seconds = 0,
start_year = 2018, 2018, 2018,
start_month = 03, 03, 03,
start_day = 30, 30, 30,
start_hour = 00, 00, 00,
start_minute = 00, 00, 00,
start_second = 00, 00, 00,
end_year = 2018, 2018, 2018,
end_month = 04, 04, 04,
end_day = 01, 01, 01,
end_hour = 12, 12, 12,
end_minute = 00, 00, 00,
end_second = 00, 00, 00,
interval_seconds = 21600,
input_from_file = .true., .true., .true.,
history_interval = 60, 60, 60,
frames_per_outfile = 1000, 1000, 1000,
restart = .false.,
restart_interval = 5000,
io_form_history = 2,
io_form_restart = 2,
io_form_input = 2,
io_form_boundary = 2,
debug_level = 0,
/

&domains

eta_levels = 1.000, 0.9655, 0.931, 0.8966, 0.8621,
0.8276, 0.7931, 0.7586, 0.7241, 0.6897,
0.6552, 0.6207, 0.5862, 0.5517, 0.5172,
0.4828, 0.4483, 0.4138, 0.3793, 0.3448,
0.3103, 0.2759, 0.2414, 0.2069, 0.1724,
0.1379, 0.1034, 0.069, 0.0345, 0.000,
time_step =27,
time_step_fract_num = 0,
time_step_fract_den = 1,
max_dom = 1,
e_we = 150, 235, 346,
e_sn = 102, 160, 265,
e_vert = 30,30,30,
p_top_requested = 5000.0
num_metgrid_levels = 32,
num_metgrid_soil_levels = 4,
dx = 27000, 9000, 3000,
dy = 27000, 9000, 3000,
grid_id = 1, 2, 3,
parent_id = 1, 1, 2,
i_parent_start = 1, 40, 78,
j_parent_start = 1, 28, 38,
parent_grid_ratio = 1, 3, 3,
parent_time_step_ratio = 1, 3, 3,
feedback = 1,
smooth_option = 0,
/

&physics
mp_physics = 3, 3, 3,
ra_lw_physics = 1, 1, 1,
ra_sw_physics = 1, 1, 1,
radt = 30, 30, 30,
sf_sfclay_physics = 1, 1, 1,
sf_surface_physics = 2, 2, 2,
bl_pbl_physics = 1, 1, 1,
bldt = 0, 0, 0,
cu_physics = 1, 1, 0,
cudt = 5, 5, 5,
isfflx = 1,
ifsnow = 0,
icloud = 1,
surface_input_source = 1,
num_soil_layers = 4,
sf_urban_physics = 0, 0, 0,
maxiens = 1,
maxens = 3,
maxens2 = 3,
maxens3 = 16,
ensdim = 144,
/

&fdda
/

&dynamics
w_damping = 0,
diff_opt = 1,
km_opt = 4,
diff_6th_opt = 0, 0, 0,
diff_6th_factor = 0.12, 0.12, 0.12,
base_temp = 290.,
damp_opt = 0,
zdamp = 5000., 5000., 5000.,
dampcoef = 0.2, 0.2, 0.2,
khdif = 0, 0, 0,
kvdif = 0, 0, 0,
non_hydrostatic = .true., .true., .true.,
moist_adv_opt = 1, 1, 1,
scalar_adv_opt = 1, 1, 1,
/

&bdy_control
spec_bdy_width = 5,
spec_zone = 1,
relax_zone = 4,
specified = .true., .false., .false.,
nested = .false., .true., .true.,
/

&grib2
/

&namelist_quilt
nio_tasks_per_group = 0,
nio_groups = 1,

and rsl.error.0000 in below

taskid: 0 hostname: node1
module_io_quilt_old.F 2931 F
Quilting with 1 groups of 0 I/O tasks.
Ntasks in X 1, ntasks in Y 1
WRF V4.0 MODEL
*************************************
Parent domain
ids,ide,jds,jde 1 150 1 102
ims,ime,jms,jme -4 155 -4 107
ips,ipe,jps,jpe 1 150 1 102
*************************************
DYNAMICS OPTION: Eulerian Mass Coordinate
alloc_space_field: domain 1, 312799268 bytes allocated
med_initialdata_input: calling input_input
Input data is acceptable to use: wrfinput_d01
Timing for processing wrfinput file (stream 0) for domain 1: 0.08472 elapsed seconds
Max map factor in domain 1 = 1.01. Scale the dt in the model accordingly.
INPUT LandUse = "MODIFIED_IGBP_MODIS_NOAH"
LANDUSE TYPE = "MODIFIED_IGBP_MODIS_NOAH" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 17 SNOW CATEGORY = 15
INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
Timing for Writing wrfout_d01_2018-03-30_00:00:00 for domain 1: 0.37572 elapsed seconds
d01 2018-03-30_00:00:00 Input data is acceptable to use: wrfbdy_d01
Timing for processing lateral boundary for domain 1: 0.01265 elapsed seconds
Tile Strategy is not specified. Assuming 1D-Y
WRF TILE 1 IS 1 IE 150 JS 1 JE 102
WRF NUMBER OF TILES = 1
Fatal error in MPI_Allreduce:
Invalid MPI_Op, error stack:
MPI_Allreduce(886)..........: MPI_Allreduce(sbuf=0x341f870, rbuf=0x341f890, count=1, MPI_2INTEGER, MPI_MINLOC, comm=0xc4000000) failed
MPIR_MINLOC_check_dtype(215): MPI_Op MPI_MINLOC operation not defined for this datatype
 
kwthomas said:
Hi...

I thought I was the only person who had problems with bizarre crashes of WRF and friends. :)

Things to consider:

Look at *ALL* rsl.* files. Maybe one has a more useful complaint.

Does this happen all attempts? Is each run using a different node group? There is always
the possibility of a bad node.

Are you building with Intel 17.x or Intel 18.x compilers? If so, they sometimes generate badly
optimized code that causes early crashes. Try a lower optimization level on the build.

MPI has environmental variables that control how MPI runs. Sometimes, the default values
are insufficient for all problem sizes. Check with your System's people or check the man page
for your MPI implementation to see things to try. Unfortunately, MPI implementations are all
different.

Good luck.
Click to expand...

Thank you for your reply, the complier is ifort version 13.1.3, and Ver of WRF is v4.0. I had complie and run WRF V3.2, everything is OK.
This time, I had run real.exe in both of one core or several core , can get the wrfbdy and wrfinput files, but wrf.exe is not very well. I try to set the max_dom = 1, and time_step =27,run wrf.exe in one core still get the same result.

Now my namelist.input looks like
&time_control
run_days = 2,
run_hours = 12,
run_minutes = 0,
run_seconds = 0,
start_year = 2018, 2018, 2018,
start_month = 03, 03, 03,
start_day = 30, 30, 30,
start_hour = 00, 00, 00,
start_minute = 00, 00, 00,
start_second = 00, 00, 00,
end_year = 2018, 2018, 2018,
end_month = 04, 04, 04,
end_day = 01, 01, 01,
end_hour = 12, 12, 12,
end_minute = 00, 00, 00,
end_second = 00, 00, 00,
interval_seconds = 21600,
input_from_file = .true., .true., .true.,
history_interval = 60, 60, 60,
frames_per_outfile = 1000, 1000, 1000,
restart = .false.,
restart_interval = 5000,
io_form_history = 2,
io_form_restart = 2,
io_form_input = 2,
io_form_boundary = 2,
debug_level = 0,
/

&domains

eta_levels = 1.000, 0.9655, 0.931, 0.8966, 0.8621,
0.8276, 0.7931, 0.7586, 0.7241, 0.6897,
0.6552, 0.6207, 0.5862, 0.5517, 0.5172,
0.4828, 0.4483, 0.4138, 0.3793, 0.3448,
0.3103, 0.2759, 0.2414, 0.2069, 0.1724,
0.1379, 0.1034, 0.069, 0.0345, 0.000,
time_step =27,
time_step_fract_num = 0,
time_step_fract_den = 1,
max_dom = 1,
e_we = 150, 235, 346,
e_sn = 102, 160, 265,
e_vert = 30,30,30,
p_top_requested = 5000.0
num_metgrid_levels = 32,
num_metgrid_soil_levels = 4,
dx = 27000, 9000, 3000,
dy = 27000, 9000, 3000,
grid_id = 1, 2, 3,
parent_id = 1, 1, 2,
i_parent_start = 1, 40, 78,
j_parent_start = 1, 28, 38,
parent_grid_ratio = 1, 3, 3,
parent_time_step_ratio = 1, 3, 3,
feedback = 1,
smooth_option = 0,
/

&physics
mp_physics = 3, 3, 3,
ra_lw_physics = 1, 1, 1,
ra_sw_physics = 1, 1, 1,
radt = 30, 30, 30,
sf_sfclay_physics = 1, 1, 1,
sf_surface_physics = 2, 2, 2,
bl_pbl_physics = 1, 1, 1,
bldt = 0, 0, 0,
cu_physics = 1, 1, 0,
cudt = 5, 5, 5,
isfflx = 1,
ifsnow = 0,
icloud = 1,
surface_input_source = 1,
num_soil_layers = 4,
sf_urban_physics = 0, 0, 0,
maxiens = 1,
maxens = 3,
maxens2 = 3,
maxens3 = 16,
ensdim = 144,
/

&fdda
/

&dynamics
w_damping = 0,
diff_opt = 1,
km_opt = 4,
diff_6th_opt = 0, 0, 0,
diff_6th_factor = 0.12, 0.12, 0.12,
base_temp = 290.,
damp_opt = 0,
zdamp = 5000., 5000., 5000.,
dampcoef = 0.2, 0.2, 0.2,
khdif = 0, 0, 0,
kvdif = 0, 0, 0,
non_hydrostatic = .true., .true., .true.,
moist_adv_opt = 1, 1, 1,
scalar_adv_opt = 1, 1, 1,
/

&bdy_control
spec_bdy_width = 5,
spec_zone = 1,
relax_zone = 4,
specified = .true., .false., .false.,
nested = .false., .true., .true.,
/

&grib2
/

&namelist_quilt
nio_tasks_per_group = 0,
nio_groups = 1,
/

and the file of rsl.err.0000 in run wrf.exe on one core with commond line ./wrf.exe in below

taskid: 0 hostname: node1
module_io_quilt_old.F 2931 F
Quilting with 1 groups of 0 I/O tasks.
Ntasks in X 1, ntasks in Y 1
WRF V4.0 MODEL
*************************************
Parent domain
ids,ide,jds,jde 1 150 1 102
ims,ime,jms,jme -4 155 -4 107
ips,ipe,jps,jpe 1 150 1 102
*************************************
DYNAMICS OPTION: Eulerian Mass Coordinate
alloc_space_field: domain 1, 312799268 bytes allocated
med_initialdata_input: calling input_input
Input data is acceptable to use: wrfinput_d01
Timing for processing wrfinput file (stream 0) for domain 1: 0.08472 elapsed seconds
Max map factor in domain 1 = 1.01. Scale the dt in the model accordingly.
INPUT LandUse = "MODIFIED_IGBP_MODIS_NOAH"
LANDUSE TYPE = "MODIFIED_IGBP_MODIS_NOAH" FOUND 33 CATEGORIES 2 SEASONS WATER CATEGORY = 17 SNOW CATEGORY = 15
INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
Timing for Writing wrfout_d01_2018-03-30_00:00:00 for domain 1: 0.37572 elapsed seconds
d01 2018-03-30_00:00:00 Input data is acceptable to use: wrfbdy_d01
Timing for processing lateral boundary for domain 1: 0.01265 elapsed seconds
Tile Strategy is not specified. Assuming 1D-Y
WRF TILE 1 IS 1 IE 150 JS 1 JE 102
WRF NUMBER OF TILES = 1
Fatal error in MPI_Allreduce:
Invalid MPI_Op, error stack:
MPI_Allreduce(886)..........: MPI_Allreduce(sbuf=0x341f870, rbuf=0x341f890, count=1, MPI_2INTEGER, MPI_MINLOC, comm=0xc4000000) failed
MPIR_MINLOC_check_dtype(215): MPI_Op MPI_MINLOC operation not defined for this datatype


By the way, I had run
ulimit -s unlimited
ulimit -c unlimited
ulimit -m unlimited

Before run wrf.exe.


Thanks again.
 
For a grid interval of 27km, time step can be set to 150. Other than that, your namelist.input looks fine.

As suggested by Kevin, please look at all your RSL files to see whether you can find other error messages that probably can give us more hints what is wrong.

Another option is to run the case in debug mode, which will yield the exact code and line where the run failed.

By the way, can you run the case using older version of WRF?
 
You must log in or register to reply here.
Top