Search found 90 matches

by davegill
Fri May 07, 2021 10:52 pm
Forum: wrf.exe
Topic: arw v3.9.1.1 with dm+sm
Replies: 3
Views: 88

Re: arw v3.9.1.1 with dm+sm

A couple of points that will not solve your model failure: It is likely that DM-only is about as fast as DM+SM. If your entire purpose for DM+SM is performance, this may not be all that important for you. Have you looked at different decompositions with MPI? The default is 5 (north south) and 4 (eas...
by davegill
Tue Feb 09, 2021 5:44 pm
Forum: metgrid
Topic: file sizes after metgrid.exe (version 4.2.2)
Replies: 7
Views: 280

Re: file sizes after metgrid.exe (version 4.2.2)

The default for netcdf has been to have compression activated, starting with release v4.0 (SHA a19f3d6424). Here is that modification. commit a19f3d64244d4435cd1aa9b2a8459ba296a9b3c9 Author: Dave Gill <gill@ucar.edu> Date: Mon Mar 26 18:23:00 2018 -0600 NETCDF4 compression is now default (#415) TYPE...
by davegill
Tue Feb 09, 2021 2:22 am
Forum: Special Running Options
Topic: Allocation error when number of trajectories is increased beyond 1000?
Replies: 4
Views: 198

Re: Allocation error when number of trajectories is increased beyond 1000?

Stacey, It sure seems like you are doing this the right way, based on the mods you made. Let's start from the beginning, and take a look at the errors in the build to see if those give us a clue. ./clean -a ./configure -D Build the code to run on ONE processor. ./compile em_real -j 1>& foo Build the...
by davegill
Tue Feb 02, 2021 5:59 pm
Forum: Dynamics and Numerics
Topic: Change in spec_zone of lateral boundary conditions during runtime
Replies: 8
Views: 491

Re: Change in spec_zone of lateral boundary conditions during runtime

For a sanity check, are you able to get access to a different global data set?

Here is a web site at NCAR:
0.25 degree GFS
by davegill
Thu Jan 28, 2021 8:29 pm
Forum: Dynamics and Numerics
Topic: Change in spec_zone of lateral boundary conditions during runtime
Replies: 8
Views: 491

Re: Change in spec_zone of lateral boundary conditions during runtime

The fields from the physics schemes are influenced by lateral boundaries, since fields that are forced by the lateral boundaries (loosely: u, v, t, q, height, pressure) are all input the physics schemes. However, a field such as skin temperature does not get nudged directly via a boundary condition....
by davegill
Fri Jan 22, 2021 4:08 am
Forum: wrf.exe
Topic: lowest levels in metgrid over complex terrain
Replies: 4
Views: 250

Re: lowest levels in metgrid over complex terrain

Peter, 1. A model lid of 1 mb is pretty high up, but that should not pose troubles. 2. Unrelated to the model blowing up, with a model lid about 50 mb, use the RRTMG radiation schemes. There is no ozone in option #1. You could get a decent temperature bias aloft. 3. Your definition of the stratosphe...
by davegill
Wed Jan 20, 2021 6:00 pm
Forum: WRF Code Modification
Topic: Gradient of resolved turbulent heat flux in WRF-LES 3.9.1.1 (du'T'/dx, dv'T'/dy dw'T'/dz)
Replies: 2
Views: 305

Re: Gradient of resolved turbulent heat flux in WRF-LES 3.9.1.1 (du'T'/dx, dv'T'/dy dw'T'/dz)

Winston, Yes, this looks exactly like an MPI communications issue. This could be a back and forth discussion. Please let me know if I am interpreting anything incorrectly. I'll grab a few snippets of your code, just for the u values (for simplicity). If these are all mass points, the variables are r...
by davegill
Thu Jan 07, 2021 8:49 pm
Forum: High-performance Computing
Topic: WRF V4.0 MPI run does not work with too many processors
Replies: 8
Views: 1937

Re: WRF V4.0 MPI run does not work with too many processors

The WRF model has a simple algorithm for the default domain decomposition. However, it can be adjusted. Assume that you would prefer to have 27 decompositions in the i-direction, and 20 decompositions in the j-direction. In namelist.input: &domains nproc_x = 27 nproc_y = 20 / This will allow you to ...
by davegill
Wed Dec 23, 2020 4:46 pm
Forum: Idealized Cases
Topic: Why module_initialize_ideal.F does not take effect?
Replies: 14
Views: 541

Re: Why module_initialize_ideal.F does not take effect?

In the share/output_wrf.F file, add a call to model_to_grid_config_rec as the third executable statement: CALL wrf_debug( 300 , wrf_err_message ) CALL modify_io_masks ( grid%id ) ! this adjusts the I/O masks according to the users run-time specs, if any + CALL model_to_grid_config_rec ( grid%id , mo...
by davegill
Fri Dec 18, 2020 9:41 pm
Forum: High-performance Computing
Topic: (RESOLVED) IO quilt crash - cheyenne
Replies: 4
Views: 252

Re: IO quilt crash - cheyenne

Charles,
Since this is on cheyenne, can you point to a directory that we can poke around in?
by davegill
Mon Dec 14, 2020 11:21 pm
Forum: Dynamics and Numerics
Topic: Unable to successfully modify zap_close_levels
Replies: 7
Views: 423

Re: Unable to successfully modify zap_close_levels

How comfortable are you with Fortran? Years ago I put in code to provide the vertical interpolation scheme in the real program with a stand-alone testing capability. I have been tinkering with it today to get it back into shape. It is almost ready to go. The idea would be for you to input a column o...
by davegill
Mon Dec 14, 2020 4:55 pm
Forum: Dynamics and Numerics
Topic: Change in spec_zone of lateral boundary conditions during runtime
Replies: 8
Views: 491

Re: Change in spec_zone of lateral boundary conditions during runtime

OK, we are getting somewhere! As you indicate, there is a unphysical discontinuity for the T field on th western side of your domain. The PH and MU fields look suspect, but they could just be responding to the T field. We are going to focus on the T field (almost a potential temperature field). We w...
by davegill
Fri Dec 11, 2020 10:56 pm
Forum: Dynamics and Numerics
Topic: Unable to successfully modify zap_close_levels
Replies: 7
Views: 423

Re: Unable to successfully modify zap_close_levels

Let's look at two approaches: what you are using now, and maybe what could be missing. What you are using now The "zap_close_levels" is a real.exe feature. After the real.exe program runs, look at a column of data in the wrfinput_d01 file for a grid point that is over the ocean (we want as little el...
by davegill
Fri Dec 11, 2020 10:00 pm
Forum: Dynamics and Numerics
Topic: Change in spec_zone of lateral boundary conditions during runtime
Replies: 8
Views: 491

Re: Change in spec_zone of lateral boundary conditions during runtime

This is will a back and forth process. The lateral boundary conditions do not directly control the physics fields, such as the skin temperature. The lateral boundary conditions in WRF control the dynamics fields that require horizontal differencing to advance the state. It is absolutely possible tha...
by davegill
Thu Dec 03, 2020 5:52 am
Forum: WPS Compiling/Installation
Topic: (RESOLVED) Ungrib compilation failed: Integer too big for integer kind 8
Replies: 10
Views: 600

Re: Ungrib compilation failed: Integer too big for integer kind 8

For more completeness, there are compilation flags to ignore the range on the integer values. Here is the code with the offending line included: pi@raspberrypi:~/TOYS $ cat /mnt/mydisk/gill/test.f90 program i8size implicit none integer(kind=8)::i write(0,*) huge(i) write(0,*) storage_size(i) write(0...
by davegill
Thu Dec 03, 2020 5:27 am
Forum: WPS Compiling/Installation
Topic: (RESOLVED) Ungrib compilation failed: Integer too big for integer kind 8
Replies: 10
Views: 600

Re: Ungrib compilation failed: Integer too big for integer kind 8

Michael, It had been too long ago since I changed the ungrib code, I forgot about the need to swap the leading "F" to a "7". I decided to dig in more now to see why this is happening on the pi. It turns out that this is one of the places where the standard allows a processor to choose what to do. He...
by davegill
Wed Dec 02, 2020 10:46 pm
Forum: WPS Compiling/Installation
Topic: (RESOLVED) Ungrib compilation failed: Integer too big for integer kind 8
Replies: 10
Views: 600

Re: Ungrib compilation failed: Integer too big for integer kind 8

I have had this same issue. I ran this suggested test code: pi@raspberrypi:~/TOYS $ cat test.f90 program i8size implicit none integer(kind=8)::i write(0,*) huge(i) stop end program i8size Here is the version of gfortran I used: pi@raspberrypi:~/TOYS $ gfortran --version GNU Fortran (Raspbian 8.3.0-6...
by davegill
Mon Nov 23, 2020 3:56 pm
Forum: WRF Compiling/Installation
Topic: About new NVIDIA HPC SDK
Replies: 3
Views: 269

Re: About new NVIDIA HPC SDK

Thank you for the information. I have passed this on to the administrators on our NCAR supercomputer platform. Once we have a machine where we may test the nvfortran and nvc compilers, we can include the SDK compiler/tools in the standard WRF build options.
by davegill
Fri Nov 06, 2020 9:49 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 452

Re: Segmentation fault on ndown

Thomas,
First we see why the ndown program is not working. The vertical spacing may be a problem later in WRF, but ndown is just interpolating.
by davegill
Fri Nov 06, 2020 6:56 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 452

Re: Segmentation fault on ndown

We tried to go 900m to 300m with ndown instead of 100m, and were able to get it to run with just deleting vert_refine_method.
So to not confound the test, can you try the original 900 m -> 100 m, without the vertical refinement?
by davegill
Fri Nov 06, 2020 5:25 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 452

Re: Segmentation fault on ndown

Thomas, OK, looks like you are in for some detective work. The problem does not appear to be memory related. The two other pieces that you mention could be an issue: the vertical refinement or the nested ratio. It would be worthwhile to test each separately. The vertical refinement requires turning ...
by davegill
Mon Nov 02, 2020 11:55 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 452

Re: Segmentation fault on ndown

Thomas, Maybe this is related to memory usage, as the ndown jobs stops just before doing anything with the fine grid. NDOWN_EM V4.2 PREPROCESSOR ndown_em: calling alloc_and_configure_domain coarse ************************************* Parent domain ids,ide,jds,jde 1 138 1 187 ims,ime,jms,jme -4 30 -...
by davegill
Wed Oct 21, 2020 9:11 pm
Forum: Running
Topic: Troubles creating LBC lateral boundary files
Replies: 1
Views: 201

Troubles creating LBC lateral boundary files

I am trying to set up and run a regional MPAS domain. I have the following for my "india" domain: 1. india.grid.nc 2. india.static.nc 3. india.graph.info All of the three above came from the create_region python script from https://github.com/MiCurry/MPAS-Limited-Area . 4. india.graph.info.part.36 T...
by davegill
Fri Oct 16, 2020 7:40 pm
Forum: WRF Compiling/Installation
Topic: Parallel Netcdf4 I/O support (as opposed to pnetcdf)
Replies: 5
Views: 797

Re: Parallel Netcdf4 I/O support (as opposed to pnetcdf)

There is no current work being done with WRF to take advantage of the parallel aspects of netcdf4. The compression makes the output take about 3x longer. If your only intent is to get data out of the model quickly, we see output speed-ups of 10x on AWS and > 50x on a dedicated HPC when using the io_...

Go to advanced search