AMD EPYC 9554 & EPYC 9654 Benchmarks - Outstanding Performance For Linux HPC/Servers

OpenVINO for Intel's open-source AI software project was performing terrific on the AMD EPYC 9004 "Genoa" processors with AVX-512. The Xeon Platinum 8362/8380 processors delivered better performance over the Milan/Milan-X CPUs thanks to AVX-512, but Genoa's efficient AVX-512 implementation led to far higher performance now with OpenVINO.

The uplift with OpenVINO for Genoa is so dramatic that the performance-per-dollar value is far beyond that of existing Intel/AMD CPUs.

OpenVINO was a stronghold for Intel Xeon Scalable "Ice Lake" over Milan/Milan-X but the EPYC 9554 "Genoa" processor can even compete with two Xeon Platinum 8380 processors. The performance out of Genoa is nuts.

Across the many different models tested, OpenVINO 2022 was performing excellent with EPYC Genoa processors thanks to the AVX-512 support. While initially I was concerned over Zen 4's AVX-512 implementation using a 256-bit data path, it has proven to perform very well and without the power/thermal implications of AVX-512 on earlier Intel CPUs.