Hello,
I am trying to run da with himawari radiance.
I convert himawari hsd data to netcdf using cspp_geocat software and renamed the output geocatL1.HIMAWARI-9.2023231.060000.FLDK.R20.nc L1AHITBR and geocatL2.HIMAWARI-9.2023231.060000.FLDK.R20.nc one L2AHICLP.
Here some part of my namelist.input file:
&wrfvar4
use_ahiobs = true,
&wrfvar14
rtminit_nsensor=1,
rtminit_platform=31,
rtminit_satid=8,
rtminit_sensor=56,
thinning_mesh=60,
thinning=false,
qc_rad=true,
write_iv_rad_ascii=false,
write_oa_rad_ascii=true,
rtm_option=2,
only_sea_rad=false,
use_varbc=false
crtm_coef_path="crtm_coeffs_2.3.0/"
ahi_info is there, and radiance_info directory too.
Here is the errors I am having while trying to run wrfda:
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 237
NETCDF4 read error for: Latitude of Observation Point
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 254
NETCDF4 read error for: Longitude of Observation Point
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 302
NETCDF4 read error for: satellite zenith angle
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 330
NETCDF4 read error for: CLTYPE data
---------------------------------------------------------------
I looked at the netcdf files generated by geocat, they seem all right.
For example if I display L1AHITBR file with python I see:
In [4]: ds
Out[4]:
<class 'netCDF4._netCDF4.Dataset'>
root group (NETCDF4 data model, file format HDF5):
Ancillary_Data_Directory: ./data/
Ancillary_Package_Version: NA
Channel_Number_Convention: instrument-native
Earth-Sun_Distance: 1.0120881795883179
Element_Resolution: 2.0
Element_Stride: 1
First_Element_Processed: 1
First_Line_Processed: 1
GEOCAT_Total_Runtime: 2683.0645141601562
GEOCAT_Version: cspp-geo-geocat-1.0
Image_Date_Time: 2023-08-19T06:00:00Z
Last_Element_Processed: 5500
Last_Line_Processed: 5500
Latitude_Range: [-74.59255981 74.59255981]
Level1a_Directory: ./20230819_06
Level1a_File: geocatL1.HIMAWARI-9.2023231.060000.FLDK.R20.nc
Level1b_Directory: ./20230819_06
Level1b_File: HS_H09_20230819_0600_B05_FLDK
Line_Resolution: 2.0
Line_Segment_Size: 2910
Longitude_Range: [ 66.12870026 215.39465332]
Maximum_Valid_Viewing_Zenith_Angle: 85
Navigation_Method: On-the-fly
Original_NumberOfElements: 5500
Original_NumberOfLines: 5500
Original_UpperLeftElement_Coordinate: -999
Original_UpperLeftLine_Coordinate: 0
Output_Library_Version: HDF Version 4.2 Release 14, June 26, 2018
Percentage_Day: 100.0
Percentage_Night: 0.0
Percentage_Terminator: 0.0
Planck_Method: TABLE
Platform_ID: 287
Platform_Name: HIMAWARI-9
Precomputed_Navigation_File: NA
Processing_Machine: armidale
Production_DateTime: 2023-08-21T15:47:59+00:00
Projection_Longitude: 140.75991821289062
Satellite_Height: 42164000.0
Scanning_Domain_Id: 1
Scanning_Domain_Name: FLDK
Scanning_Domain_Options: FLDK,JP,R3
Sensor_ID: 287
Sensor_Name: himawari8
Sensor_Name_HyperIR: MISSING
Sensor_Name_Imager: AHI
Spacecraft_Name: HIMAWARI-9
Subsatellite_Longitude: 140.75991821289062
Test_Package_Version: NA
WMO_BUFR_Spacecraft_ID: 174
WMO_Spacecraft_ID: 671
X_Offset_Nav: 2750.5
X_Scale_Nav: 20466276.0
Y_Offset_Nav: 2750.5
Y_Scale_Nav: 20466276.0
Years_Since_Launch: 6.632443428039551
Geocat_build: GEOCAT cspp-geo-geocat-1.0
PROJ4_string: +proj=geos +over +lon_0=140.700 +lat_0=0.000 +a=6378137.000 +f=0.0033528129638281333 +h=35785863.0 +sweep=x
dimensions(sizes): channel_index(18), detector(1), lines(5500), elements(5500)
variables(dimensions): int16 himawari_9_ahi_channel_10_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_11_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_12_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_13_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_14_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_15_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_16_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_1_reflectance(lines, elements), int16 himawari_9_ahi_channel_2_reflectance(lines, elements), int16 himawari_9_ahi_channel_3_reflectance(lines, elements), int16 himawari_9_ahi_channel_4_reflectance(lines, elements), int16 himawari_9_ahi_channel_5_reflectance(lines, elements), int16 himawari_9_ahi_channel_6_reflectance(lines, elements), int16 himawari_9_ahi_channel_7_brightness_temperature(lines, elements), float32 himawari_9_ahi_channel_7_emissivity(lines, elements), int16 himawari_9_ahi_channel_7_reflectance(lines, elements), int16 himawari_9_ahi_channel_8_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_9_brightness_temperature(lines, elements), int8 pixel_ecosystem_type(lines, elements), float32 pixel_latitude(lines, elements), float32 pixel_longitude(lines, elements), int16 pixel_relative_azimuth_angle(lines, elements), int16 pixel_satellite_zenith_angle(lines, elements), int16 pixel_solar_zenith_angle(lines, elements), int8 pixel_surface_type(lines, elements)
In [8]: ds['himawari_9_ahi_channel_10_brightness_temperature'][:].compressed()
Out[8]:
array([239.03683584, 239.03683584, 239.15387432, ..., 215.8354442 ,
215.8354442 , 216.06357006])
Looks all right to me.
Any clues where the error could be?
Best regards
I am trying to run da with himawari radiance.
I convert himawari hsd data to netcdf using cspp_geocat software and renamed the output geocatL1.HIMAWARI-9.2023231.060000.FLDK.R20.nc L1AHITBR and geocatL2.HIMAWARI-9.2023231.060000.FLDK.R20.nc one L2AHICLP.
Here some part of my namelist.input file:
&wrfvar4
use_ahiobs = true,
&wrfvar14
rtminit_nsensor=1,
rtminit_platform=31,
rtminit_satid=8,
rtminit_sensor=56,
thinning_mesh=60,
thinning=false,
qc_rad=true,
write_iv_rad_ascii=false,
write_oa_rad_ascii=true,
rtm_option=2,
only_sea_rad=false,
use_varbc=false
crtm_coef_path="crtm_coeffs_2.3.0/"
ahi_info is there, and radiance_info directory too.
Here is the errors I am having while trying to run wrfda:
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 237
NETCDF4 read error for: Latitude of Observation Point
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 254
NETCDF4 read error for: Longitude of Observation Point
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 273
NETCDF4 read error for: Brightness Temperature
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 302
NETCDF4 read error for: satellite zenith angle
---------------------------------------------------------------
--------------------------- WARNING ---------------------------
WARNING FROM FILE: da_read_obs_netcdf4ahi_geocat.inc LINE: 330
NETCDF4 read error for: CLTYPE data
---------------------------------------------------------------
I looked at the netcdf files generated by geocat, they seem all right.
For example if I display L1AHITBR file with python I see:
In [4]: ds
Out[4]:
<class 'netCDF4._netCDF4.Dataset'>
root group (NETCDF4 data model, file format HDF5):
Ancillary_Data_Directory: ./data/
Ancillary_Package_Version: NA
Channel_Number_Convention: instrument-native
Earth-Sun_Distance: 1.0120881795883179
Element_Resolution: 2.0
Element_Stride: 1
First_Element_Processed: 1
First_Line_Processed: 1
GEOCAT_Total_Runtime: 2683.0645141601562
GEOCAT_Version: cspp-geo-geocat-1.0
Image_Date_Time: 2023-08-19T06:00:00Z
Last_Element_Processed: 5500
Last_Line_Processed: 5500
Latitude_Range: [-74.59255981 74.59255981]
Level1a_Directory: ./20230819_06
Level1a_File: geocatL1.HIMAWARI-9.2023231.060000.FLDK.R20.nc
Level1b_Directory: ./20230819_06
Level1b_File: HS_H09_20230819_0600_B05_FLDK
Line_Resolution: 2.0
Line_Segment_Size: 2910
Longitude_Range: [ 66.12870026 215.39465332]
Maximum_Valid_Viewing_Zenith_Angle: 85
Navigation_Method: On-the-fly
Original_NumberOfElements: 5500
Original_NumberOfLines: 5500
Original_UpperLeftElement_Coordinate: -999
Original_UpperLeftLine_Coordinate: 0
Output_Library_Version: HDF Version 4.2 Release 14, June 26, 2018
Percentage_Day: 100.0
Percentage_Night: 0.0
Percentage_Terminator: 0.0
Planck_Method: TABLE
Platform_ID: 287
Platform_Name: HIMAWARI-9
Precomputed_Navigation_File: NA
Processing_Machine: armidale
Production_DateTime: 2023-08-21T15:47:59+00:00
Projection_Longitude: 140.75991821289062
Satellite_Height: 42164000.0
Scanning_Domain_Id: 1
Scanning_Domain_Name: FLDK
Scanning_Domain_Options: FLDK,JP,R3
Sensor_ID: 287
Sensor_Name: himawari8
Sensor_Name_HyperIR: MISSING
Sensor_Name_Imager: AHI
Spacecraft_Name: HIMAWARI-9
Subsatellite_Longitude: 140.75991821289062
Test_Package_Version: NA
WMO_BUFR_Spacecraft_ID: 174
WMO_Spacecraft_ID: 671
X_Offset_Nav: 2750.5
X_Scale_Nav: 20466276.0
Y_Offset_Nav: 2750.5
Y_Scale_Nav: 20466276.0
Years_Since_Launch: 6.632443428039551
Geocat_build: GEOCAT cspp-geo-geocat-1.0
PROJ4_string: +proj=geos +over +lon_0=140.700 +lat_0=0.000 +a=6378137.000 +f=0.0033528129638281333 +h=35785863.0 +sweep=x
dimensions(sizes): channel_index(18), detector(1), lines(5500), elements(5500)
variables(dimensions): int16 himawari_9_ahi_channel_10_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_11_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_12_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_13_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_14_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_15_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_16_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_1_reflectance(lines, elements), int16 himawari_9_ahi_channel_2_reflectance(lines, elements), int16 himawari_9_ahi_channel_3_reflectance(lines, elements), int16 himawari_9_ahi_channel_4_reflectance(lines, elements), int16 himawari_9_ahi_channel_5_reflectance(lines, elements), int16 himawari_9_ahi_channel_6_reflectance(lines, elements), int16 himawari_9_ahi_channel_7_brightness_temperature(lines, elements), float32 himawari_9_ahi_channel_7_emissivity(lines, elements), int16 himawari_9_ahi_channel_7_reflectance(lines, elements), int16 himawari_9_ahi_channel_8_brightness_temperature(lines, elements), int16 himawari_9_ahi_channel_9_brightness_temperature(lines, elements), int8 pixel_ecosystem_type(lines, elements), float32 pixel_latitude(lines, elements), float32 pixel_longitude(lines, elements), int16 pixel_relative_azimuth_angle(lines, elements), int16 pixel_satellite_zenith_angle(lines, elements), int16 pixel_solar_zenith_angle(lines, elements), int8 pixel_surface_type(lines, elements)
In [8]: ds['himawari_9_ahi_channel_10_brightness_temperature'][:].compressed()
Out[8]:
array([239.03683584, 239.03683584, 239.15387432, ..., 215.8354442 ,
215.8354442 , 216.06357006])
Looks all right to me.
Any clues where the error could be?
Best regards