Scheduled Downtime
On Friday 21 April 2023 @ 5pm MT, this website will be down for maintenance and expected to return online the morning of 24 April 2023 at the latest

ERA5 surface data not found in WPS

@mfe_et
Can you use the g1print.exe (or g2print.exe, depending whether your data are grib1 or grib2 format) utility to issue the following. From the WPS directory, issue

Code:
./util/g1print.exe <path-to-your-input-data>/<input_data_file> >& g1print.log

Obviously entering your actual path to the data and the actual name of the data file for your surface fields. Then attach the g1print.log file so I can take a look. Thanks!
Hi ,
in my met files there are no value for TT UU VV RH PSCF , I use this command that you sent here and this is the output:
Copen: File = ........../Build_WRF/Data/S-data.grib
Fortran Unit = 0
UNIX File descriptor: 3

STOP findgrib
----------------------------------------------------
rec GRIB GRIB Lvl Lvl Lvl Time Fcst
Num Code name Code one two hour
----------------------------------------------------
End-of-record mark (7777) not found 533668047
Sec0(1) = 26214508 0
1 155 D 100 1 0 2008-08-20_00:00 + 00
*** stopping in findgrib in gribcode ***\n
\tI could not find the GRIB string in the input file
\tafter testing the first 100,000 bytes.
\tThe file may be corrupt or it is not a GRIB file.
\tPerhaps a gzipped GRIB file or netcdf?\n

my input data( pressure level and single level : I download separately) are from cds (API code) and are 23G . could you please help me what is the problem.
 

Attachments

  • SFC-data.txt
    12.1 KB · Views: 0
  • pressure-level-data.txt
    1.5 KB · Views: 0
If you intend to use ERA5 data, please download ERA5 data from:
NCAR RDA Dataset d633000

We provide a python package to process the ERA5 data for WRF application:
GitHub - NCAR/era5_to_int: A simple Python script for converting ERA5 model-level netCDF files to the WPS intermediate format

I suppose this is an easy way for people to implement ERA5.

Please try and let me know if you have any issues. Thanks.
Hi , I tried to download in different times data but I faced with this massage from the site:

Internal server error​

Sorry, there seems to be an error. Please try again soon.​

 

Attachments

  • Screenshot from 2025-03-28 14-30-45.png
    Screenshot from 2025-03-28 14-30-45.png
    76.4 KB · Views: 3
NCAR RDA just changed its path to ERA5 data. Unfortunately they didn't make a public announce .... I am sorry for the inconvenience caused by this.

Please download the updated python package from the same link I posted previously, then rerun the case.

Let me know if you still have troubles to run the package.
 
NCAR RDA just changed its path to ERA5 data. Unfortunately they didn't make a public announce .... I am sorry for the inconvenience caused by this.

Please download the updated python package from the same link I posted previously, then rerun the case.

Let me know if you still have troubles to run the package.
thanks for your reply. I have a question now. I downloaded the ERA5 grib1 data and run WPS and did not see TT and UU and VV in met files. So yo suggest that I download data in netcdf format and then convert them with the python code that you mention in previous comment?
 
That is correct. Note that ERA5 GRIB data have been removed from NCAR RDA. All the ERA data for download are in netCDF format. The python package we created can be implemented to process ERA5 data in netCDF format.
 
That is correct. Note that ERA5 GRIB data have been removed from NCAR RDA. All the ERA data for download are in netCDF format. The python package we created can be implemented to process ERA5 data in netCDF format.
Hi Ming
Thank you very much for the updates. I have successfully downloaded all the necessary netCDF files (surface and pressure levels). When running the package with the following command:

era5_to_int:era5_to_int.py --path /WPS/ERA5/inp/2023 -i 2023-03-29_00 2023-04-30_23 3

I encountered the following error message:

Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2023032900_2023032905.nc, needed for the ERA5 variable SP.

I’m unclear as to why it this file, which is ERA5 Reanalysis Model Level Data corresponds to a 6-hour interval, is required, as I am requesting output for 3-hour intervals using ERA5 pressure-level data rather than model-level with option -i (--isobaric).

Could you please help me resolve this issue?

Thanks again!
 
Last edited:
Hi, I have a similar issue. I am trying to run ./metgrid.exe using two era data (surface level and pressure level) but I keep getting this the following error,
Processing domain 1 of 1
Processing 2022-10-30_00
FILE
SFILE
WARNING: Field PRES has missing values at level 200100 at (i,j)=(1,1)
WARNING: Field PMSL has missing values at level 200100 at (i,j)=(1,1)
WARNING: Field PSFC has missing values at level 200100 at (i,j)=(1,1)
WARNING: Field SOILHGT has missing values at level 200100 at (i,j)=(1,1)
WARNING: Field GHT has missing values at level 200100 at (i,j)=(1,1)
ERROR: Missing values encountered in interpolated fields. Stopping.
I tried the above mentioned fixes such as increasing the domain size and running ungrib twice for each era data, but the issue still persists. Please find my namelist.wps file for reference.
 

Attachments

  • namelist.wps
    780 bytes · Views: 0
Hi Feng,
This is a file containing surface pressure. It is the same in both datasets of model level and pressure level. We simply choose to use the data from the model level dataset.
 
If you intend to use ERA5 data, please download ERA5 data from:
NCAR RDA Dataset d633000

We provide a python package to process the ERA5 data for WRF application:
GitHub - NCAR/era5_to_int: A simple Python script for converting ERA5 model-level netCDF files to the WPS intermediate format

I suppose this is an easy way for people to implement ERA5.

Please try and let me know if you have any issues. Thanks.
Dear Ming Chen,

I am currently preparing WPS inputs using ERA5 data and have encountered an issue in the met_em output files after converting and running them through metgrid. I would like to summarize the steps I followed and describe the problem in detail:
  • Downloaded ERA5 pressure-level and single-level (surface) data from the NCAR RDA Dataset d633000
  • Used the era5_to_int.py script to convert datasets to WPS intermediate format.
  • Verified intermediate files (e.g., ERA5:...) were created successfully for all time steps.
  • Received normal messages like GEOPT is NOT being written...Computing GHT at..., which I understand are expected when GEOPT is calculated rather than present in source files.
  • metgrid.exe completed without fatal errors.
  • All met_em.d01.*.nc files were created.
When I open the met_em.d01.2008-08-20_XX:00:00.nc files in ncview, many variables such as UU, TT, and others appear flat or uniform, and maps show unrealistic homogeneous shading (e.g., one color block across the entire domain). See attached screenshot for reference.

Would you please guied me what is the problem?
 

Attachments

  • Screenshot from 2025-04-29 13-45-55.png
    Screenshot from 2025-04-29 13-45-55.png
    41.1 KB · Views: 2
  • namelist.wps
    1.4 KB · Views: 1
(1) Would you please send me a list of the ERA5 data you downloaded?
(2) What command did you issue to run the python script?
(3) Can you upload a single met_em for me to take a look?
Thanks.
 
(1) Would you please send me a list of the ERA5 data you downloaded?
(2) What command did you issue to run the python script?
(3) Can you upload a single met_em for me to take a look?
Thanks.
here is the files:
about met_em I can not send it here because of the size error. I sent it by email to you.
 

Attachments

  • list-of-data.txt
    4.2 KB · Views: 2
  • era5_to_int.txt
    25.7 KB · Views: 1
Hi,

It seems that you didn't download correct ERA5 data files. Below are the files you should download. Please get these files and rerun your case.

e5.oper.an.pl.128_129_z.ll025sc.2008082000_2008082023.nc


e5.oper.an.pl.128_133_q.ll025sc.2008082000_2008082023.nc


e5.oper.an.pl.128_130_t.ll025sc.2008082000_2008082023.nc


e5.oper.an.pl.128_131_u.ll025uv.2008082000_2008082023.nc


e5.oper.an.pl.128_132_v.ll025uv.2008082000_2008082023.nc


e5.oper.invariant.128_172_lsm.ll025sc.1979010100_1979010100.nc


e5.oper.an.sfc.128_034_sstk.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_235_skt.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_039_swvl1.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_040_swvl2.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_041_swvl3.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_042_swvl4.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_139_stl1.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_170_stl2.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_183_stl3.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_236_stl4.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_031_ci.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_167_2t.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_168_2d.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_165_10u.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_166_10v.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_033_rsn.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_141_sd.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_151_msl.ll025sc.2008080100_2008083123.nc


e5.oper.an.ml.128_134_sp.regn320sc.2008082000_2008082005.nc


e5.oper.invariant.128_129_z.regn320sc.2016010100_2016010100.nc
 
Hi,

It seems that you didn't download correct ERA5 data files. Below are the files you should download. Please get these files and rerun your case.

e5.oper.an.pl.128_129_z.ll025sc.2008082000_2008082023.nc


e5.oper.an.pl.128_133_q.ll025sc.2008082000_2008082023.nc


e5.oper.an.pl.128_130_t.ll025sc.2008082000_2008082023.nc


e5.oper.an.pl.128_131_u.ll025uv.2008082000_2008082023.nc


e5.oper.an.pl.128_132_v.ll025uv.2008082000_2008082023.nc


e5.oper.invariant.128_172_lsm.ll025sc.1979010100_1979010100.nc


e5.oper.an.sfc.128_034_sstk.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_235_skt.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_039_swvl1.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_040_swvl2.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_041_swvl3.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_042_swvl4.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_139_stl1.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_170_stl2.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_183_stl3.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_236_stl4.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_031_ci.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_167_2t.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_168_2d.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_165_10u.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_166_10v.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_033_rsn.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_141_sd.ll025sc.2008080100_2008083123.nc


e5.oper.an.sfc.128_151_msl.ll025sc.2008080100_2008083123.nc


e5.oper.an.ml.128_134_sp.regn320sc.2008082000_2008082005.nc


e5.oper.invariant.128_129_z.regn320sc.2016010100_2016010100.nc
Hi,
Thank you for your reply.

I downloaded the data you listed and ran the era5_to_int.py script. However, I encountered the following error:

Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2008082006_2008082011.nc needed for ERA5 variable SP
Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2008082012_2008082017.nc needed for ERA5 variable SP
Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2008082018_2008082023.nc needed for ERA5 variable SP

In the Python code, the SP variable is defined as:
int_vars.append(MetVar('PSFC', 'SP', 'e5.oper.an.ml.128_134_sp.regn320sc.{}_{}.nc', begin_6hourly, end_6hourly, Gaussian))

But the file you mentioned and I downloaded is:
e5.oper.an.ml.128_134_sp.regn320sc.2008082000_2008082005.nc

Should I download the next time chunk (e.g., 2008082006_2008082011.nc) manually? Or Do I change the script?


and I downloaded data and still my met_em files from time 01:00 to 23:00 has the same error that I mentioned before. only the time 00 has the non zero value for TT,UU and...

I attached the converted data (output from ./rd_intermediate.exe / ) It seems that the converting did correctly.
 

Attachments

  • ERA5-20080820_13:00.txt
    99.6 KB · Views: 0
Last edited:
Hi,
Thank you for your reply.

I downloaded the data you listed and ran the era5_to_int.py script. However, I encountered the following error:

Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2008082006_2008082011.nc needed for ERA5 variable SP
Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2008082012_2008082017.nc needed for ERA5 variable SP
Error: Could not find file e5.oper.an.ml.128_134_sp.regn320sc.2008082018_2008082023.nc needed for ERA5 variable SP

In the Python code, the SP variable is defined as:
int_vars.append(MetVar('PSFC', 'SP', 'e5.oper.an.ml.128_134_sp.regn320sc.{}_{}.nc', begin_6hourly, end_6hourly, Gaussian))

But the file you mentioned and I downloaded is:
e5.oper.an.ml.128_134_sp.regn320sc.2008082000_2008082005.nc

Should I download the next time chunk (e.g., 2008082006_2008082011.nc) manually? Or Do I change the script?


and I downloaded data and still my met_em files from time 01:00 to 23:00 has the same error that I mentioned before. only the time 00 has the non zero value for TT,UU and...

I attached the converted data (output from ./rd_intermediate.exe / ) It seems that the converting did correctly.
When I deactivate process_only_bdy = 5, in the metgrid section in namelist.wps, the problem is solved. Is this a safe solution?
 
Is there any special reason you set process_only_bdy = 5?

I don't think this option should cause any trouble. However, era5_to_init is a new package, and there might be some issues that lead to confliction to process_only_bdy.

Anyway, please run without this option as the beginning point.
 
Top