program wrf: error opening wrfinput_d01 for reading ierr= -1021

[MUWRFDA]

I have run WRF V-4.4.2 on Ubuntu 22.04 for close to two years on a remote server. Everything worked very well until end of April. From 1st May an error occurred where neither WPS nor WRF could run. There was an error, which I cannot reproduce but it contained "INVALID INVALID ...". From the posts I solved this with "sudo apt install openmpi-bin". After this WPS runs but wrf gives the error above.
I have been on this since the beginning of May and I cannot figure out what the problem could be, despite the many posts on this.
I have attached the two namelists and rsl files after running real.exe then stopping the run, and rsl files after running wrf.exe.
What i do not understand is why there are 32 rsl files for real.exe when only 16 cores were requested for real.exe. 16 rsl files for real show successful completion of real.exe. In the wrf.exe files there is a date of 2023 which I do not understand where it comes from, and it shows a domain of 6km instead of 15km.
Several other users have accounts on the same server and there wrf runs show the same error.
I would appreciate if anyone has any idea on this.

 

[kwerner]

Hi,
The error message when running wrf is:

FATAL CALLED FROM FILE:  <stdin>  LINE:      70
program wrf: error opening wrfinput_d01 for reading ierr=       -1021

This typically means that real.exe was not successful. Is the wrfinput_d01 file available in the wrf running directory? Are you able to view the file with something like 'ncview,' or to do an 'ncdump -h' to print the contents of the file? If not, then the file may be corrupt and you should re-run real.

However, the fact that everything suddenly changed, not just for you, but for other users on your system, seems to indicate a system issue, which we are unable to help with. I would advise talking to a systems administrator at your institution for guidance.