Hi all, I have a 2-domain nested model that runs with no errors, but when I introduce the "restart_interval" parameter (with "restart=.false.") wrf.exe will run all the way to the end and bail while writing the wrfrst files. Often the wrfrst file for domain 1 will complete before the error occurs (EDIT: it seems that it doesn't finish writing domain 1, but gets somewhat close), however in this example the program failed while writing domain 1. Executables were compiled with "WRFIO_NCD_LARGE_FILE_SUPPORT=1" and I have no problem writing large (> 7GB) input files with real.exe. Any help I can get with troubleshooting this problem would be much appreciated!
Timing for main: time 1974-01-02_04:59:40 on domain 1: 1.00705 elapsed seconds
Timing for main: time 1974-01-02_04:59:45 on domain 2: 0.16771 elapsed seconds
Timing for main: time 1974-01-02_04:59:50 on domain 2: 0.20322 elapsed seconds
Timing for main: time 1974-01-02_04:59:55 on domain 2: 0.20213 elapsed seconds
Timing for main: time 1974-01-02_05:00:00 on domain 2: 0.20210 elapsed seconds
mediation_integrate.G 1242 DATASET=HISTORY
mediation_integrate.G 1243 grid%id 2 grid%oid 4
Timing for Writing wrfout_d02_1974-01-02_05:00:00 for domain 2: 1.29688 elapsed seconds
Timing for main: time 1974-01-02_05:00:00 on domain 1: 2.31661 elapsed seconds
mediation_integrate.G 1242 DATASET=HISTORY
mediation_integrate.G 1243 grid%id 1 grid%oid 4
Timing for Writing wrfout_d01_1974-01-02_05:00:00 for domain 1: 0.56472 elapsed seconds
Timing for Writing restart for domain 1: 63.82768 elapsed seconds
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
wrf.exe 00000000235EECBB for__signal_handl Unknown Unknown
libpthread-2.26.s 00001555529672D0 Unknown Unknown Unknown
libmpich_intel.so 0000155552DB1220 MPID_nem_gni_poll Unknown Unknown
libmpich_intel.so 0000155552D8EDB6 MPIDI_CH3I_Progre Unknown Unknown
libmpich_intel.so 0000155552CD442D MPIC_Wait Unknown Unknown
libmpich_intel.so 0000155552CD46C7 MPIC_Recv Unknown Unknown
libmpich_intel.so 0000155552CFA99C MPIR_CRAY_Bcast_T Unknown Unknown
libmpich_intel.so 0000155552CFC7E8 MPIR_CRAY_Bcast Unknown Unknown
libmpich_intel.so 0000155552C0C54B MPIR_Bcast_impl Unknown Unknown
libmpich_intel.so 0000155552CF8DB4 MPIR_CRAY_Gatherv Unknown Unknown
libmpich_intel.so 0000155552C1C904 MPIR_Gatherv_impl Unknown Unknown
libmpich_intel.so 0000155552C1CE19 MPI_Gatherv Unknown Unknown
wrf.exe 00000000206C5D07 Unknown Unknown Unknown
wrf.exe 00000000206B10C8 Unknown Unknown Unknown
wrf.exe 000000002136420C Unknown Unknown Unknown
wrf.exe 000000002116CB31 Unknown Unknown Unknown
wrf.exe 0000000021213D3C Unknown Unknown Unknown
wrf.exe 00000000212164E5 Unknown Unknown Unknown
wrf.exe 0000000020197EA7 Unknown Unknown Unknown
wrf.exe 0000000020017A91 Unknown Unknown Unknown
wrf.exe 0000000020017A49 Unknown Unknown Unknown
wrf.exe 00000000200179D2 Unknown Unknown Unknown
libc-2.26.so 00001555525BD34A __libc_start_main Unknown Unknown
wrf.exe 00000000200178EA Unknown Unknown Unknown
Attachments
Last edited: