Scheduled Downtime
On Friday 21 April 2023 @ 5pm MT, this website will be down for maintenance and expected to return online the morning of 24 April 2023 at the latest

Atmosphere model run failed using MPI+OMP

This post was from a previous version of the WRF&MPAS-A Support Forum. New replies have been disabled and if you have follow up questions related to this post, then please start a new thread from the forum home page.

Sylvia

New member
Hello everyone,

I'm running the atmosphere model using MPI+OMP. The mesh resolution is 60 km. The run succeeded using only MPI, while failed using MPI+OMP. Since I submitted my job using nohup, followed are contents of the nohup log file (see also the attachment run_atmosphere.log).

nohup: ignoring input
Copyright (C) 2009-2019 Intel Corporation. All rights reserved.
Intel(R) Advisor 2019 (build 602216)
forrtl: severe (174): SIGSEGV, segmentation fault occurred
forrtl: severe (174): SIGSEGV, segmentation fault occurred
forrtl: severe (174): SIGSEGV, segmentation fault occurred
forrtl: severe (174): SIGSEGV, segmentation fault occurred


I used 20 MPI tasks with each having 2 threads to run the atmosphere model. Followed is my job submission script (see also the attachment run_atmosphere):

ulimit -s unlimited
export OMP_NUM_THREADS=2
mpirun -n 20 -machinefile hostfile ./atmosphere_model


The atmosphere model was installed supporting OpenMP using command "make ifort CORE=atmosphere USE_PIO2=true DEBUG=true OPENMP=true". I used Intel 2020 basic compiler (ifort, icc and icpc) and mvapich MPI compiler (mpif90, mpicc, mpicxx) to compile the model. The mvapich and other MPAS libruary source codes were downloaded from the site (https://www2.mmm.ucar.edu/people/duda/files/mpas/sources/).


The input data I used is CFSR:2010-10-23_00, which is the Sample real-data input file provided by the MPAS website http://mpas-dev.github.io/. Please find log.atmosphere.0000.out, streams.atmosphere and namelist.atmosphere files in the attached. I also attached the namelist.init_atmosphere files and streams.init_atmosphere files for both static data interpolation and initial condition interpolation.


Thank you in advance!
 

Attachments

  • log.atmosphere.0000.out.dat
    10.3 KB · Views: 33
  • namelist.atmosphere.dat
    1.7 KB · Views: 38
  • namelist.init_atmosphere_geo.dat
    1.4 KB · Views: 31
  • namelist.init_atmosphere_met.dat
    1.3 KB · Views: 39
  • run_atmosphere.dat
    100 bytes · Views: 35
  • run_atmosphere.log.dat
    359 bytes · Views: 40
  • streams.atmosphere.dat
    1.5 KB · Views: 34
  • streams.init_atmosphere_geo.dat
    919 bytes · Views: 30
  • streams.init_atmosphere_met.dat
    962 bytes · Views: 34
Top