Using New Landuse Data: FRC_URB2D file generation (RESOLVED)

Questions related to the use of new landuse, or geographical static data, or to modifications to the existing data
Post Reply
dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Using New Landuse Data: FRC_URB2D file generation (RESOLVED)

Post by dashie » Tue Apr 27, 2021 5:56 am

I'm using land cover data for parts of Ontario that has impervious fraction built in, and I want to use it since the included nlcd file only has data for the US. However, I'm having trouble -- the geo_em files show reasonable values of frc_urb2d in the US but no values (all 0) in Canada.

I followed the directions in the WRF user's guide to create this. hexdump shows that the binary file was correctly written (not all 0, and is of the correct size. As a test, I changed fill_missing to 1 in GEOGRID.TBL for diagnostic purposes -- the geo_em files were now all 1.

To test further, I changed the name of the file and saw that I got the same result, and geogrid didn't so much as throw a warning. Therefore, I suspect that geogrid is not reading in the binary file at all. Why might this be? I'm sure I named it correctly (00001-48233.00001-35255). Is it because of its size (1.7 GB)?

Attached are the index and GEOGRID.TBL files.

Thanks in advance for your help!
Attachments
index.txt
(386 Bytes) Downloaded 6 times
GEOGRID.TBL
(19.88 KiB) Downloaded 5 times

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Thu Apr 29, 2021 11:16 pm

Hi,
Can you also attach your namelist.wps file so I can see how you are linking to your static data? Thanks!
NCAR/MMM

dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Re: FRC_URB2D file generation

Post by dashie » Thu Apr 29, 2021 11:23 pm

kwerner wrote:
Thu Apr 29, 2021 11:16 pm
Hi,
Can you also attach your namelist.wps file so I can see how you are linking to your static data? Thanks!
Here it is -- thanks in advance!
Attachments
namelist.wps
(979 Bytes) Downloaded 5 times

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Fri Apr 30, 2021 9:15 pm

Hi,
I apologize - a couple more questions.
1) Can you let me know the directory structure of your new data? For e.g., is it inside "/home/dashie/projects/def-skrayenh/GEOG?" If so, is the index file inside another directory inside GEOG, along with the other data files? Please let me know the name of that directory and then go into that directory and issue

Code: Select all

ls -ls >& new_data.txt
and send me that new_data.txt file

2) You mentioned you want to use NLCD data also? If so, which one? What else were you hoping to use in addition to NLCD (e.g., MODIS or USGS)?

3) What version of wps are you using?

Thanks!
NCAR/MMM

dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Re: FRC_URB2D file generation

Post by dashie » Sat May 01, 2021 6:53 pm

kwerner wrote:
Fri Apr 30, 2021 9:15 pm
Hi,
I apologize - a couple more questions.
1) Can you let me know the directory structure of your new data? For e.g., is it inside "/home/dashie/projects/def-skrayenh/GEOG?" If so, is the index file inside another directory inside GEOG, along with the other data files? Please let me know the name of that directory and then go into that directory and issue

Code: Select all

ls -ls >& new_data.txt
and send me that new_data.txt file

2) You mentioned you want to use NLCD data also? If so, which one? What else were you hoping to use in addition to NLCD (e.g., MODIS or USGS)?

3) What version of wps are you using?

Thanks!
Hi! Thanks for your help. My datum is in /home/dashie/projects/def-skrayenh/GEOG/solris

Code: Select all

[dashie@cedar1 ~]$ cd ~/projects/def-skrayenh/GEOG/
[dashie@cedar1 GEOG]$ ls
albedo_modis                          nlcd2011_ll_9s    soiltype_top_30s
greenfrac_fpar_modis                  NUDAPT44_1km      solris
lai_modis_10m                         orogwd_10m        topo_gmted2010_30s
lai_modis_30s                         orogwd_1deg       urbfrac_nlcd2011
maxsnowalb_modis                      orogwd_20m        varsso
misc                                  orogwd_2deg       varsso_10m
modis_landuse_20class_30s_with_lakes  orogwd_30m        varsso_2m
nlcd2011_can_ll_9s                    soiltemp_1deg     varsso_5m
nlcd2011_imp_ll_9s                    soiltype_bot_30s
[dashie@cedar1 GEOG]$ cd solris
[dashie@cedar1 solris]$ ll
total 34435
-rw-r----- 1 dashie def-skrayenh 1700454415 Apr 26 15:41 00001-48233.00001-35255
-rw-r----- 1 dashie def-skrayenh        385 Apr 27 14:38 index
[dashie@cedar1 solris]$ pwd
/home/dashie/projects/def-skrayenh/GEOG/solris
[dashie@cedar1 solris]$ 
I was planning on using NLCD urban data ('nlcd2011_9s'), but it doesn't have any urban data for my study area, so I reverted to the default '30m' which I believe is MODIS.

I am using the latest version, WPS 4.2.

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Mon May 03, 2021 11:17 pm

Hi,
In WPSV4.2, the default landuse is actually:

Code: Select all

rel_path =        default:modis_landuse_20class_30s_with_lakes/
I was curious whether you added your new data this to the GEOGRID.TBL, and I see that you did:

Code: Select all

name=FRC_URB2D
        priority=1
        optional=yes
        dest_type=continuous
        fill_missing = 1.
        interp_option=default: average_gcell(2.0)+four_pt
        rel_path=default:solris/
        flag_in_output=FLAG_FRC_URB2D
However, if you want to use the default landuse, as well as that solris data, you need to set your namelist resolution to:

Code: Select all

geog_data_res      = 'default','default','default'
I believe that should work. If not, and it's still not incorporating the solris data, in your GEOGRID.TBL, change the relative path to:

Code: Select all

rel_path=solris:solris/
and then set your namelist resolution to:

Code: Select all

geog_data_res      = 'default+solris','default+solris','default+solris'
NCAR/MMM

dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Re: FRC_URB2D file generation

Post by dashie » Tue May 04, 2021 6:31 am

kwerner wrote:
Mon May 03, 2021 11:17 pm
Hi,
In WPSV4.2, the default landuse is actually:

Code: Select all

rel_path =        default:modis_landuse_20class_30s_with_lakes/
I was curious whether you added your new data this to the GEOGRID.TBL, and I see that you did:

Code: Select all

name=FRC_URB2D
        priority=1
        optional=yes
        dest_type=continuous
        fill_missing = 1.
        interp_option=default: average_gcell(2.0)+four_pt
        rel_path=default:solris/
        flag_in_output=FLAG_FRC_URB2D
However, if you want to use the default landuse, as well as that solris data, you need to set your namelist resolution to:

Code: Select all

geog_data_res      = 'default','default','default'
I believe that should work. If not, and it's still not incorporating the solris data, in your GEOGRID.TBL, change the relative path to:

Code: Select all

rel_path=solris:solris/
and then set your namelist resolution to:

Code: Select all

geog_data_res      = 'default+solris','default+solris','default+solris'
Thanks for letting me know the default has changed.

I tried both options and it still did not work. geogrid.log says the datum is being read in and processed. But once it reaches the geo_em files, it is all zero. I know the values aren't all zero (see attachment). I also tried changing the map projection to no avail. The only thing I can think of now is that somehow the map grid is incorrect, but I'm sure the lower left corner (known lat/lon) is in the domain area so some data should be appearing in the geo_em files anyway.

Any additional troubleshooting help you can provide would be greatly appreciated!

Thanks in advance c:
Attachments
hexdump.txt
(778 Bytes) Downloaded 4 times

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Thu May 06, 2021 7:27 pm

Without looking at the data, myself, I'm not sure I'll be able to figure this out. Can you send the static data file? I know it's large, so it won't attach to this forum, but take a look at the home page of the forum for instructions on providing large files. After, you can let me know where I can find the file.

Please also attach your updated namelist.wps file.

Thanks!
NCAR/MMM

dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Re: FRC_URB2D file generation

Post by dashie » Thu May 06, 2021 7:38 pm

kwerner wrote:
Thu May 06, 2021 7:27 pm
Without looking at the data, myself, I'm not sure I'll be able to figure this out. Can you send the static data file? I know it's large, so it won't attach to this forum, but take a look at the home page of the forum for instructions on providing large files. After, you can let me know where I can find the file.

Please also attach your updated namelist.wps file.

Thanks!
Hello, it actually compresses up quite nicely -- so here it is attached. Thanks so much for your help!
Attachments
00001-48233.00001-35255.gz
(7.01 MiB) Downloaded 5 times

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Thu May 06, 2021 7:55 pm

Thanks for the quick response! Can you send your updated namelist.wps file too? I can do without it, but I'd like to check over it again.
NCAR/MMM

dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Re: FRC_URB2D file generation

Post by dashie » Thu May 06, 2021 8:06 pm

kwerner wrote:
Thu May 06, 2021 7:55 pm
Thanks for the quick response! Can you send your updated namelist.wps file too? I can do without it, but I'd like to check over it again.
Here it is
Attachments
namelist.wps
(1012 Bytes) Downloaded 5 times

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Tue May 11, 2021 10:33 pm

Thanks for sending those. When I set the following in the namelist.wps file:

Code: Select all

geog_data_res = 'default'
and in the GEOGRID.TBL, I set

Code: Select all

name=FRC_URB2D
        priority=1
        optional=yes
        dest_type=continuous
        fill_missing = 0.
        interp_option=default: average_gcell(2.0)+four_pt
        rel_path=default:solris/
        flag_in_output=FLAG_FRC_URB2D
===============================
After running geogrid.exe, I get values for FRC_URB2D in my domain 01 plot (I didn't check for additional domains since I figured you were getting zeros on all domains). I'm attaching a screen shot of the output from the geo_em.d01.nc file.

Just to be sure, you are using your modified GEOGRID.TBL file, correct? If you go into the geogrid/ directory and issue
ls -ls
you should see that your GEOGRID.TBL is pointing to the correct/modified file.

Also, check your geogrid.log to see if FRC_URB2D is being processed.
Attachments
FRC_URB2D.png
NCAR/MMM

dashie
Posts: 7
Joined: Tue Apr 27, 2021 5:38 am

Re: FRC_URB2D file generation

Post by dashie » Thu May 13, 2021 9:37 pm

kwerner wrote:
Tue May 11, 2021 10:33 pm
Thanks for sending those. When I set the following in the namelist.wps file:

Code: Select all

geog_data_res = 'default'
and in the GEOGRID.TBL, I set

Code: Select all

name=FRC_URB2D
        priority=1
        optional=yes
        dest_type=continuous
        fill_missing = 0.
        interp_option=default: average_gcell(2.0)+four_pt
        rel_path=default:solris/
        flag_in_output=FLAG_FRC_URB2D
===============================
After running geogrid.exe, I get values for FRC_URB2D in my domain 01 plot (I didn't check for additional domains since I figured you were getting zeros on all domains). I'm attaching a screen shot of the output from the geo_em.d01.nc file.

Just to be sure, you are using your modified GEOGRID.TBL file, correct? If you go into the geogrid/ directory and issue
ls -ls
you should see that your GEOGRID.TBL is pointing to the correct/modified file.

Also, check your geogrid.log to see if FRC_URB2D is being processed.
I went ahead and tried recompiling & running on a different system, and it worked, except I had to remove the nlcd entry for FRC_URB2D from my GEOGRID.TBL, which seemed to overwrite this datum no matter what priority it's set to.

This behaviour is good enough for my case, however, so no further help is needed. Thanks for your help!

kwerner
Posts: 2287
Joined: Wed Feb 14, 2018 9:21 pm

Re: FRC_URB2D file generation

Post by kwerner » Wed May 19, 2021 10:28 pm

I'm so glad to hear that! Thank you for letting us know.
NCAR/MMM

Post Reply

Return to “New/Modified Static Data”