Wrfout files in GRIB format

ykaore · Dec 13, 2023

Hi all,

I would like to have my WRF output files in GRIB format. In the user guide, it says to set io_form_history = 5 (GRIB1) or = 10 (GRIB2). However, when I do that, I get the error below, the wrfout is not created but the simulation goes on. Can someone help me? There is something else that I should set to have my outputs in GRIB format.

INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
open_hist_w : error opening wrfout_d01_2023-12-12_00:00:00 for writing. 100
mediation_integrate.G 1242 DATASET=HISTORY
mediation_integrate.G 1243 grid%id 1 grid%oid 1
Timing for Writing wrfout_d01_2023-12-12_00:00:00 for domain 1: 0.00977 elapsed seconds
d01 2023-12-12_00:00:00 Input data is acceptable to use: wrfbdy_d01
Timing for processing lateral boundary for domain 1: 2.74403 elapsed seconds
Tile Strategy is not specified. Assuming 1D-Y
WRF TILE 1 IS 1 IE 22 JS 1 JE 15
WRF NUMBER OF TILES = 1
d01 2023-12-12_00:00:00 ----------------------------------------
d01 2023-12-12_00:00:00 W-DAMPING BEGINS AT W-COURANT NUMBER = 1.00000000
d01 2023-12-12_00:00:00 ----------------------------------------
Timing for main: time 2023-12-12_00:00:50 on domain 1: 3.72910 elapsed seconds
Timing for main: time 2023-12-12_00:01:40 on domain 1: 0.15755 elapsed seconds
Timing for main: time 2023-12-12_00:02:30 on domain 1: 0.15764 elapsed seconds
Timing for main: time 2023-12-12_00:03:20 on domain 1: 0.16229 elapsed seconds
Timing for main: time 2023-12-12_00:04:10 on domain 1: 0.15127 elapsed seconds

If I set io_form_history = 2 (NetCDF), everything works fine!

haiqingsong · Dec 14, 2023

ykaore said:
Hi all,

I would like to have my WRF output files in GRIB format. In the user guide, it says to set io_form_history = 5 (GRIB1) or = 10 (GRIB2). However, when I do that, I get the error below, the wrfout is not created but the simulation goes on. Can someone help me? There is something else that I should set to have my outputs in GRIB format.

INITIALIZE THREE Noah LSM RELATED TABLES
Skipping over LUTYPE = USGS
LANDUSE TYPE = MODIFIED_IGBP_MODIS_NOAH FOUND 20 CATEGORIES
INPUT SOIL TEXTURE CLASSIFICATION = STAS
SOIL TEXTURE CLASSIFICATION = STAS FOUND 19 CATEGORIES
open_hist_w : error opening wrfout_d01_2023-12-12_00:00:00 for writing. 100
mediation_integrate.G 1242 DATASET=HISTORY
mediation_integrate.G 1243 grid%id 1 grid%oid 1
Timing for Writing wrfout_d01_2023-12-12_00:00:00 for domain 1: 0.00977 elapsed seconds
d01 2023-12-12_00:00:00 Input data is acceptable to use: wrfbdy_d01
Timing for processing lateral boundary for domain 1: 2.74403 elapsed seconds
Tile Strategy is not specified. Assuming 1D-Y
WRF TILE 1 IS 1 IE 22 JS 1 JE 15
WRF NUMBER OF TILES = 1
d01 2023-12-12_00:00:00 ----------------------------------------
d01 2023-12-12_00:00:00 W-DAMPING BEGINS AT W-COURANT NUMBER = 1.00000000
d01 2023-12-12_00:00:00 ----------------------------------------
Timing for main: time 2023-12-12_00:00:50 on domain 1: 3.72910 elapsed seconds
Timing for main: time 2023-12-12_00:01:40 on domain 1: 0.15755 elapsed seconds
Timing for main: time 2023-12-12_00:02:30 on domain 1: 0.15764 elapsed seconds
Timing for main: time 2023-12-12_00:03:20 on domain 1: 0.16229 elapsed seconds
Timing for main: time 2023-12-12_00:04:10 on domain 1: 0.15127 elapsed seconds

If I set io_form_history = 2 (NetCDF), everything works fine!

Edit WRF/arch/Config.pl，
Modify this line：I_really_want_to_output_grib2_from_WRF = "FALSE" to I_really_want_to_output_grib2_from_WRF = "TRUE"
And clean -a
then recompile the WRF！

Ming Chen · Dec 17, 2023

@ykaore

Please try haiqingsong's option. It is highly appreciated if you can post the result in the Forum. Thanks in advance.

ykaore · Dec 20, 2023

Hi,

I tried your solution, that means (1) ./clean -a, (2) set up I_really_want_to_output_grib2_from_WRF = "TRUE", (3) I did some exports for HDF5, JASPERINC, JASPERLIB, and NETCDF, and finally ./compile again. However, I got this error. I don't know what I should do. Thanks for you help.

/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_addfield_w_': io_grib2.f90

.text+0x1912): undefined reference to `addfield_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_addgrid_w_': io_grib2.f90

.text+0x2167): undefined reference to `addgrid_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_create_w_': io_grib2.f90

.text+0x271b): undefined reference to `gribcreate_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_fill_local_use_': io_grib2.f90

.text+0x3ed0): undefined reference to `addlocal_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x413c): undefined reference to `gribend_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_open_for_read_begin_': io_grib2.f90

.text+0x4f40): undefined reference to `getgb2_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x547b): undefined reference to `gf_free_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x5923): undefined reference to `getgb2_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x608e): undefined reference to `gf_free_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x624a): undefined reference to `gf_free_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_fill_levels_': io_grib2.f90

.text+0x6ae5): undefined reference to `getgb2_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_write_field_': io_grib2.f90

.text+0xb54d): undefined reference to `gribend_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/gilberto/WRF/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_read_field_': io_grib2.f90

.text+0xc80e): undefined reference to `getgb2_' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0xcf88): undefined reference to `gf_free_' collect2: error: ld returned 1 exit status Command exited with non-zero status 1 0.62user 0.20system 0:01.13elapsed 72%CPU (0avgtext+0avgdata 145076maxresident)k 16200inputs+116216outputs (0major+32056minor)pagefaults 0swapsmake[1]: [Makefile:17: em_wrf] Error 1 (ignored)

Ming Chen · Dec 20, 2023

Thank you for the update. I am sorry about the trouble. We seldom run with this option and I am not sure what is wrong here. I will talk to our software engineer and get back to you if we can find a solution....

ykaore · Dec 20, 2023

Another issue I'm facing (and I guess it can be related to GRIB and NetCDF output format) is related to the RAINC+RAINNC variables.
My test uses WRF to forecast some parameters for 15 days ahead. The boundary and initial conditions came from the GFS 0.25 3-h (Inventory of File gfs.t00z.pgrb2.0p25.f000)
- If I set io_form_history = 2 (NetCDF), I successfully get all my output variables (Times, XLAT, XLONG, LU_INDEX, U, V, W, T, P, Q2, T2, PSFC, U10, V10, QVAPOR, HGT, RAINC, RAINNC, CLDFRA, XLAND, LANDMASK, SST) for all forecasting timesteps (hourly output for 15 days ahead).

- Howerver, if I set io_form_history = 5 (GRIB1), I get all my output variables for all forecasting timesteps, except for RAINC+RAINNC. It seems the GRIB1 file saves RAINC+RAINNC till 10th day of forecasting. Does someone know if there is any flag/variable that I should set up to have all forecasting timesteps for RAINC+RAINNC.

- set io_form_history = 10 (GRIB2) didn't work yet (as mentioned before in this thread)

ykaore · Dec 20, 2023

@Ming Chen is there any software or package that could convert NetCDF to GRIB2? I'm asking because in NetCDF format, everything seems to work fine.

islas · Dec 20, 2023

@ykaore I had no issues building grib2 with v4.5.1, setting JASPERLIB to the location of the jasper built library version 1.900.1 and JASPERINC to the include directory of that same built jasper library.

Could you post your configure.wrf and build log?

Ming Chen · Dec 20, 2023

@ ykaore

If you are familiar with UPP, it can read wrfout files in netCDF format, and output GRIB format data. Please take a look at the UPP document here.

ykaore · Dec 21, 2023

islas said:
@ykaore I had no issues building grib2 with v4.5.1, setting JASPERLIB to the location of the jasper built library version 1.900.1 and JASPERINC to the include directory of that same built jasper library.

Could you post your configure.wrf and build log?

Hi Islas,
Thanks for your help. I'm attaching the configure.wrf file and build log here.

ykaore · Dec 21, 2023

Ming Chen said:
@ ykaore

If you are familiar with UPP, it can read wrfout files in netCDF format, and output GRIB format data. Please take a look at the UPP document here.

I tried to compile UPP, however I did not have success with that because I faced an error during the installation. I posted another topic here related to it and I got this reply. Fail to compile UPP 11.0.0

ykaore · Dec 27, 2023

I guess the error I'm getting is what has already been reported here: Grib2 output is broken · Issue #993 · wrf-model/WRF However, I don't think people have found a solution for it.

The jasper version I'm using is 2.0.14. But following the suggestions in the post, I tried to downgrade jasper version to 1.900.24, however 1.900.24 is not available in the repository. Then, I tried to use versions 1.900.22 and 1.900.29, however both presented the same error during the compilation, which I couldn't figure out what the problem was. Afterwards, I tried to update jasper to the latest version (4.1.1 GitHub - jasper-software/jasper: Official Repository for the JasPer Image Coding Toolkit ), but the same previously reported issue rose.

f951: Warning: Nonexistent include directory ‘g2lib’ [-Wmissing-include-dirs]
ar ru ../libio_grib2.a gridtemplates.o pdstemplates.o drstemplates.o gribmod.o realloc.o addfield.o addgrid.o addlocal.o getfield.o gb_info.o gf_getfld.o gf_free.o gf_unpack1.o gf_unpack2.o gf_unpack3.o gf_unpack4.o gf_unpack5.o gf_unpack6.o gf_unpack7.o gettemplates.o getlocal.o getdim.o getpoly.o gribcreate.o gribend.o gribinfo.o mkieee.o rdieee.o simpack.o simunpack.o cmplxpack.o compack.o misspack.o pack_gp.o reduce.o comunpack.o specpack.o specunpack.o jpcpack.o jpcunpack.o enc_jpeg2000.o dec_jpeg2000.o gbytesc.o skgb.o ixgb2.o getidx.o getg2i.o getg2ir.o getgb2s.o getgb2r.o getgb2l.o getgb2.o getgb2p.o getgb2rp.o putgb2.o g2grids.o gdt2gds.o mova2i.o params.o
ar: enc_jpeg2000.o: No such file or directory
make[5]: [../../io_grib_share/build/library_rules.mk:106: thisdir_archive] Error 1 (ignored)
ranlib ../libio_grib2.a
.
.
.
.

ykaore · Dec 27, 2023

io_grib2.f90

.text+0x6ae5): undefined reference to `getgb2_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_write_field_':
io_grib2.f90

.text+0xb54d): undefined reference to `gribend_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_read_field_':
io_grib2.f90

.text+0xc80e): undefined reference to `getgb2_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0xcf88): undefined reference to `gf_free_'
collect2: error: ld returned 1 exit status
Command exited with non-zero status 1
0.28user 0.15system 0:00.49elapsed 88%CPU (0avgtext+0avgdata 117080maxresident)k
214232inputs+107920outputs (0major+32908minor)pagefaults 0swaps
make[1]: [Makefile:33: em_real] Error 1 (ignored)
time mpif90 -o tc.exe -O2 -ftree-vectorize -funroll-loops -w -ffree-form -ffree-line-length-none -fconvert=big-endian -frecord-marker=4 tc_em.o ../dyn_em/module_initialize_real.o libwrflib.a /home/ykaore/wrf/models/WRFV4.5.1/external/fftpack/fftpack5/libfftpack.a /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib1/libio_grib1.a /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib_share/libio_grib_share.a /home/ykaore/wrf/models/WRFV4.5.1/external/io_int/libwrfio_int.a -L/home/ykaore/wrf/models/WRFV4.5.1/external/esmf_time_f90 -lesmf_time /home/ykaore/wrf/models/WRFV4.5.1/external/RSL_LITE/librsl_lite.a /home/ykaore/wrf/models/WRFV4.5.1/frame/module_internal_header_util.o /home/ykaore/wrf/models/WRFV4.5.1/frame/pack_utils.o -L/home/ykaore/wrf/models/WRFV4.5.1/external/io_netcdf -lwrfio_nf -L/home/gilberto/opt/lib -lnetcdff -lnetcdf -L/home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2 -lio_grib2 -L/home/gilberto/opt/jasper/lib -ljasper
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_addfield_w_':
io_grib2.f90

.text+0x1912): undefined reference to `addfield_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_addgrid_w_':
io_grib2.f90

.text+0x2167): undefined reference to `addgrid_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_create_w_':
io_grib2.f90

.text+0x271b): undefined reference to `gribcreate_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_fill_local_use_':
io_grib2.f90

.text+0x3ed0): undefined reference to `addlocal_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x413c): undefined reference to `gribend_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_open_for_read_begin_':
io_grib2.f90

.text+0x4f40): undefined reference to `getgb2_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x547b): undefined reference to `gf_free_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x5923): undefined reference to `getgb2_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x608e): undefined reference to `gf_free_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0x624a): undefined reference to `gf_free_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_fill_levels_':
io_grib2.f90

.text+0x6ae5): undefined reference to `getgb2_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_write_field_':
io_grib2.f90

.text+0xb54d): undefined reference to `gribend_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `ext_gr2_read_field_':
io_grib2.f90

.text+0xc80e): undefined reference to `getgb2_'
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: io_grib2.f90

.text+0xcf88): undefined reference to `gf_free_'
collect2: error: ld returned 1 exit status
Command exited with non-zero status 1
0.26user 0.14system 0:00.44elapsed 93%CPU (0avgtext+0avgdata 115368maxresident)k
90656inputs+106664outputs (0major+33008minor)pagefaults 0swaps
make[1]: [Makefile:34: em_real] Error 1 (ignored)
time mpif90 -o real.exe -O2 -ftree-vectorize -funroll-loops -w -ffree-form -ffree-line-length-none -fconvert=big-endian -frecord-marker=4 real_em.o ../dyn_em/module_initialize_real.o libwrflib.a /home/ykaore/wrf/models/WRFV4.5.1/external/fftpack/fftpack5/libfftpack.a /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib1/libio_grib1.a /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib_share/libio_grib_share.a /home/ykaore/wrf/models/WRFV4.5.1/external/io_int/libwrfio_int.a -L/home/ykaore/wrf/models/WRFV4.5.1/external/esmf_time_f90 -lesmf_time /home/ykaore/wrf/models/WRFV4.5.1/external/RSL_LITE/librsl_lite.a /home/ykaore/wrf/models/WRFV4.5.1/frame/module_internal_header_util.o /home/ykaore/wrf/models/WRFV4.5.1/frame/pack_utils.o -L/home/ykaore/wrf/models/WRFV4.5.1/external/io_netcdf -lwrfio_nf -L/home/gilberto/opt/lib -lnetcdff -lnetcdf -L/home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2 -lio_grib2 -L/home/gilberto/opt/jasper/lib -ljasper
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /home/ykaore/wrf/models/WRFV4.5.1/external/io_grib2/libio_grib2.a(io_grib2.o): in function `gr2_addfield_w_':
io_grib2.f90