Search found 83 matches

by davegill
Thu Jan 07, 2021 8:49 pm
Forum: High-performance Computing
Topic: WRF V4.0 MPI run does not work with too many processors
Replies: 8
Views: 979

Re: WRF V4.0 MPI run does not work with too many processors

The WRF model has a simple algorithm for the default domain decomposition. However, it can be adjusted. Assume that you would prefer to have 27 decompositions in the i-direction, and 20 decompositions in the j-direction. In namelist.input: &domains nproc_x = 27 nproc_y = 20 / This will allow you to ...
by davegill
Wed Dec 23, 2020 4:46 pm
Forum: Idealized Cases
Topic: Why module_initialize_ideal.F does not take effect?
Replies: 14
Views: 151

Re: Why module_initialize_ideal.F does not take effect?

In the share/output_wrf.F file, add a call to model_to_grid_config_rec as the third executable statement: CALL wrf_debug( 300 , wrf_err_message ) CALL modify_io_masks ( grid%id ) ! this adjusts the I/O masks according to the users run-time specs, if any + CALL model_to_grid_config_rec ( grid%id , mo...
by davegill
Fri Dec 18, 2020 9:41 pm
Forum: High-performance Computing
Topic: IO quilt crash - cheyenne
Replies: 2
Views: 28

Re: IO quilt crash - cheyenne

Charles,
Since this is on cheyenne, can you point to a directory that we can poke around in?
by davegill
Mon Dec 14, 2020 11:21 pm
Forum: Dynamics and Numerics
Topic: Unable to successfully modify zap_close_levels
Replies: 7
Views: 70

Re: Unable to successfully modify zap_close_levels

How comfortable are you with Fortran? Years ago I put in code to provide the vertical interpolation scheme in the real program with a stand-alone testing capability. I have been tinkering with it today to get it back into shape. It is almost ready to go. The idea would be for you to input a column o...
by davegill
Mon Dec 14, 2020 4:55 pm
Forum: Dynamics and Numerics
Topic: Change in spec_zone of lateral boundary conditions during runtime
Replies: 3
Views: 42

Re: Change in spec_zone of lateral boundary conditions during runtime

OK, we are getting somewhere! As you indicate, there is a unphysical discontinuity for the T field on th western side of your domain. The PH and MU fields look suspect, but they could just be responding to the T field. We are going to focus on the T field (almost a potential temperature field). We w...
by davegill
Fri Dec 11, 2020 10:56 pm
Forum: Dynamics and Numerics
Topic: Unable to successfully modify zap_close_levels
Replies: 7
Views: 70

Re: Unable to successfully modify zap_close_levels

Let's look at two approaches: what you are using now, and maybe what could be missing. What you are using now The "zap_close_levels" is a real.exe feature. After the real.exe program runs, look at a column of data in the wrfinput_d01 file for a grid point that is over the ocean (we want as little el...
by davegill
Fri Dec 11, 2020 10:00 pm
Forum: Dynamics and Numerics
Topic: Change in spec_zone of lateral boundary conditions during runtime
Replies: 3
Views: 42

Re: Change in spec_zone of lateral boundary conditions during runtime

This is will a back and forth process. The lateral boundary conditions do not directly control the physics fields, such as the skin temperature. The lateral boundary conditions in WRF control the dynamics fields that require horizontal differencing to advance the state. It is absolutely possible tha...
by davegill
Thu Dec 03, 2020 5:52 am
Forum: WPS Compiling/Installation
Topic: (RESOLVED) Ungrib compilation failed: Integer too big for integer kind 8
Replies: 10
Views: 138

Re: Ungrib compilation failed: Integer too big for integer kind 8

For more completeness, there are compilation flags to ignore the range on the integer values. Here is the code with the offending line included: pi@raspberrypi:~/TOYS $ cat /mnt/mydisk/gill/test.f90 program i8size implicit none integer(kind=8)::i write(0,*) huge(i) write(0,*) storage_size(i) write(0...
by davegill
Thu Dec 03, 2020 5:27 am
Forum: WPS Compiling/Installation
Topic: (RESOLVED) Ungrib compilation failed: Integer too big for integer kind 8
Replies: 10
Views: 138

Re: Ungrib compilation failed: Integer too big for integer kind 8

Michael, It had been too long ago since I changed the ungrib code, I forgot about the need to swap the leading "F" to a "7". I decided to dig in more now to see why this is happening on the pi. It turns out that this is one of the places where the standard allows a processor to choose what to do. He...
by davegill
Wed Dec 02, 2020 10:46 pm
Forum: WPS Compiling/Installation
Topic: (RESOLVED) Ungrib compilation failed: Integer too big for integer kind 8
Replies: 10
Views: 138

Re: Ungrib compilation failed: Integer too big for integer kind 8

I have had this same issue. I ran this suggested test code: pi@raspberrypi:~/TOYS $ cat test.f90 program i8size implicit none integer(kind=8)::i write(0,*) huge(i) stop end program i8size Here is the version of gfortran I used: pi@raspberrypi:~/TOYS $ gfortran --version GNU Fortran (Raspbian 8.3.0-6...
by davegill
Mon Nov 23, 2020 3:56 pm
Forum: WRF Compiling/Installation
Topic: About new NVIDIA HPC SDK
Replies: 3
Views: 84

Re: About new NVIDIA HPC SDK

Thank you for the information. I have passed this on to the administrators on our NCAR supercomputer platform. Once we have a machine where we may test the nvfortran and nvc compilers, we can include the SDK compiler/tools in the standard WRF build options.
by davegill
Fri Nov 06, 2020 9:49 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 159

Re: Segmentation fault on ndown

Thomas,
First we see why the ndown program is not working. The vertical spacing may be a problem later in WRF, but ndown is just interpolating.
by davegill
Fri Nov 06, 2020 6:56 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 159

Re: Segmentation fault on ndown

We tried to go 900m to 300m with ndown instead of 100m, and were able to get it to run with just deleting vert_refine_method.
So to not confound the test, can you try the original 900 m -> 100 m, without the vertical refinement?
by davegill
Fri Nov 06, 2020 5:25 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 159

Re: Segmentation fault on ndown

Thomas, OK, looks like you are in for some detective work. The problem does not appear to be memory related. The two other pieces that you mention could be an issue: the vertical refinement or the nested ratio. It would be worthwhile to test each separately. The vertical refinement requires turning ...
by davegill
Mon Nov 02, 2020 11:55 pm
Forum: Special Running Options
Topic: (RESOLVED) Segmentation fault on ndown
Replies: 11
Views: 159

Re: Segmentation fault on ndown

Thomas, Maybe this is related to memory usage, as the ndown jobs stops just before doing anything with the fine grid. NDOWN_EM V4.2 PREPROCESSOR ndown_em: calling alloc_and_configure_domain coarse ************************************* Parent domain ids,ide,jds,jde 1 138 1 187 ims,ime,jms,jme -4 30 -...
by davegill
Wed Oct 21, 2020 9:11 pm
Forum: Running
Topic: Troubles creating LBC lateral boundary files
Replies: 1
Views: 64

Troubles creating LBC lateral boundary files

I am trying to set up and run a regional MPAS domain. I have the following for my "india" domain: 1. india.grid.nc 2. india.static.nc 3. india.graph.info All of the three above came from the create_region python script from https://github.com/MiCurry/MPAS-Limited-Area . 4. india.graph.info.part.36 T...
by davegill
Fri Oct 16, 2020 7:40 pm
Forum: WRF Compiling/Installation
Topic: Parallel Netcdf4 I/O support (as opposed to pnetcdf)
Replies: 5
Views: 376

Re: Parallel Netcdf4 I/O support (as opposed to pnetcdf)

There is no current work being done with WRF to take advantage of the parallel aspects of netcdf4. The compression makes the output take about 3x longer. If your only intent is to get data out of the model quickly, we see output speed-ups of 10x on AWS and > 50x on a dedicated HPC when using the io_...
by davegill
Tue Oct 06, 2020 6:47 pm
Forum: real.exe
Topic: (SOLVED) WRF 4.2.1, real.exe immediate segmentation fault
Replies: 7
Views: 294

Re: WRF 4.2.1, real.exe immediate segmentation fault

Trevor,
Can you post the output of the failed build log that is generated when trying to build the code serially?
by davegill
Tue Oct 06, 2020 12:22 am
Forum: real.exe
Topic: (SOLVED) WRF 4.2.1, real.exe immediate segmentation fault
Replies: 7
Views: 294

Re: WRF 4.2.1, real.exe immediate segmentation fault

Argh!!

./clean -a
./configure -D << EOF
13
1
EOF
./compile em_real >& foo
by davegill
Tue Oct 06, 2020 12:20 am
Forum: real.exe
Topic: (SOLVED) WRF 4.2.1, real.exe immediate segmentation fault
Replies: 7
Views: 294

Re: WRF 4.2.1, real.exe immediate segmentation fault

Trevor, This is weird that 4.1 is OK and 4.2 is problematic. There are two ways to proceed: 1. Say the heck with v4.2 real, as the v4.1 real works just great for WRF. 2. Roll up your sleeves. Rolling up your sleeves Let's try to see if we can get any additional information from the failed run of the...
by davegill
Fri Oct 02, 2020 7:05 pm
Forum: wrf.exe
Topic: auxiliary output files missing xtime
Replies: 5
Views: 311

Re: auxiliary output files missing xtime

Gabe, Let's look at this concern from two perspectives: why do we get this behavior, and what can we do with the existing model output. First , what is causing the "xtime" behavior you see? The Registry/Registry.EM_COMMON lists the following line that defines the "xtime" variable (I removed some unn...
by davegill
Thu Sep 24, 2020 6:45 pm
Forum: WRF Compiling/Installation
Topic: Creating executables problems when compiling WRF
Replies: 3
Views: 206

Re: Creating executables problems when compiling WRF

Are you specifically trying to build with AVX options or a MIC PHI chip? If not, and all you want is a general Intel compiler, try the compiler option 15 for Linux (this is Intel with MPI). Is this build on a cluster or a desktop / laptop? Since you are using the Intel compiler, we are not too conce...
by davegill
Mon Sep 14, 2020 6:40 pm
Forum: High-performance Computing
Topic: How are nested domains divided in distributed memory execution?
Replies: 1
Views: 251

Re: How are nested domains divided in distributed memory execution?

Attached are a couple of screen shots. The first is a depiction of a WRF simulation with five total domains. The yellow area is domain 1, the blue box is domain 2, and the cyan boxes are domains 3, 4, 5. These are set up just to show us the order of operations. The second attachment shows the sequen...

Go to advanced search