NWSC-3 benchmark timing results

Questions, issues, or suggestions related to post-processing of model output.
Post Reply
afernandezody
Posts: 29
Joined: Sat Mar 07, 2020 12:00 am

NWSC-3 benchmark timing results

Post by afernandezody » Fri Oct 16, 2020 5:50 pm

Hello,
This might not be exactly a post-processing question but I wasn't sure in which subsection to post it. Taking a look at the CSEP times for the 30 km benchmark shows
MPAS_benchmarks.png
My initial expectation was that there results were measured at Cheyenne but the numbers are not clicking (for me). Would it be possible to get some information on the hardware and conditions used to perform these benchmarks? Thanks.

mgduda
Posts: 466
Joined: Mon Feb 26, 2018 7:35 pm

Re: NWSC-3 benchmark timing results

Post by mgduda » Sun Oct 18, 2020 7:29 pm

I'm not familiar with the CSEP benchmark. Do you have a link to where you obtained this spreadsheet, or do you know who performed these benchmarks?
NCAR/MMM

afernandezody
Posts: 29
Joined: Sat Mar 07, 2020 12:00 am

Re: NWSC-3 benchmark timing results

Post by afernandezody » Mon Oct 19, 2020 6:31 pm

Sorry for the delay. The link is https://www2.cisl.ucar.edu/resources/nwsc-3 and is filed under UCAR_RFP000074. My initial assumption was that someone in your team performed the benchmarks but this seems to not be the case; hence, I don't know who actually did it.

mgduda
Posts: 466
Joined: Mon Feb 26, 2018 7:35 pm

Re: NWSC-3 benchmark timing results

Post by mgduda » Mon Oct 19, 2020 10:55 pm

Thanks very much for the link -- now I know that "CSEP" stands for Cheyenne Sustained Equivalent Performance!

My guess is that someone in NCAR's Computational and Information Systems Lab produced these numbers. As you're probably aware, Cheyenne does not have any sort of accelerators -- just Broadwell CPUs -- so my guess is that the columns "Cores" and "(seconds)" under the "Cheyenne" heading are simply the benchmark cases running on Cheyenne's regular compute nodes with the code compiled "as-is" with the Intel C and Fortran compilers (and probably SGI's MPT library for MPI).
NCAR/MMM

afernandezody
Posts: 29
Joined: Sat Mar 07, 2020 12:00 am

Re: NWSC-3 benchmark timing results

Post by afernandezody » Tue Oct 20, 2020 4:21 am

Yours are similar to my first thoughts but there's more to it. As you mention, Cheyenne doesn't have accelerators so did they use some other HW or just estimated assuming some ratio? However, my foremost concern is with the full nodes results, which are supposed to be w/o accelerators. The last result points to a node (potentially a Cheyenne node) but even using Skylake processors, the time looks like too low for 36 cores (here, my assumption if that this time is the output at the end of the 'log.atmosphere.0000.out' file).
My question boils down to: Are there reliable benchmark results that can be used for comparison? Thanks.

Post Reply

Return to “Post-processing”