Howdy,
I recently adapted the standard interface for WRF 3.9 to use the capability in netcdf-4.7.4 to do parallel file IO with compression enabled (as a separate IO option). It seems to work pretty well. If there is interest to have this in WRF 4, it should be fairly easy to port forward. File sizes are nearly the same as serial netcdf-4, and faster to write. One thing is that the write efficiency can be a little finicky depending on the domain decomposition, so suggestions on handling the chunking are welcome. (It seems to do better with tiles that are wider in x and shorter in y.)
Is there interest in adding this option to WRF-4.x? If so, I can work on a PR.
-- Ted
P.S. I tried to use the PIO interface that was in a pull request (but never accepted), but could not get it to run efficiently (using compressed parallel IO).
I recently adapted the standard interface for WRF 3.9 to use the capability in netcdf-4.7.4 to do parallel file IO with compression enabled (as a separate IO option). It seems to work pretty well. If there is interest to have this in WRF 4, it should be fairly easy to port forward. File sizes are nearly the same as serial netcdf-4, and faster to write. One thing is that the write efficiency can be a little finicky depending on the domain decomposition, so suggestions on handling the chunking are welcome. (It seems to do better with tiles that are wider in x and shorter in y.)
Is there interest in adding this option to WRF-4.x? If so, I can work on a PR.
-- Ted
P.S. I tried to use the PIO interface that was in a pull request (but never accepted), but could not get it to run efficiently (using compressed parallel IO).