Intel Xeon Platinum 8592+ "Emerald Rapids" Linux Benchmarks

Written by Michael Larabel in Processors on 14 December 2023 at 10:00 AM EST. Page 9 of 10. 26 Comments.
oneDNN benchmark with settings of Harness: Convolution Batch Shapes Auto, Data Type: bf16bf16bf16, Engine: CPU. Xeon Platinum 8592+ was the fastest.
oneDNN benchmark with settings of Harness: Deconvolution Batch shapes_1d, Data Type: bf16bf16bf16, Engine: CPU. Xeon Platinum 8592+ was the fastest.

When it comes to AI software able to make use of Advanced Matrix Extensions (AMX) is the main area where Emerald Rapids is capable of sharply outperforming current AMD EPYC processors.

OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. Xeon Platinum 8592+ 2P was the fastest.
OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. Xeon Platinum 8592+ was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. EPYC 9684X 2P - Power was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. Xeon Platinum 8592+ was the fastest.

With Intel's OpenVINO software able to make effective use of AMX, the Emerald Rapids performance really leaped ahead of the AMD EPYC competition.

OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. EPYC 9684X 2P - Power was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. EPYC 9554 2P was the fastest.
OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. EPYC 9754 2P - Power was the fastest.
OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. EPYC 9554 2P was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. EPYC 9754 2P - Power was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. EPYC 9554 2P was the fastest.

In some OpenVINO test cases the AMD EPYC Genoa-X processors performed the best but overall for AMX-enabled AI software Emerald Rapids can deliver quite an advantage.

OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. Xeon Platinum 8592+ 2P was the fastest.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. Xeon Platinum 8280 2P was the fastest.
OpenVINO benchmark with settings of Model: Face Detection Retail FP16, Device: CPU. EPYC 9754 2P - Power was the fastest.
OpenVINO benchmark with settings of Model: Face Detection Retail FP16, Device: CPU. EPYC 9554 2P was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16, Device: CPU. Xeon Platinum 8592+ 2P was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16, Device: CPU. Xeon Platinum 8592+ was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. Xeon Platinum 8592+ 2P was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. Xeon Platinum 8592+ was the fastest.
OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. EPYC 9754 2P - Power was the fastest.

Intel really focused on AI during the Emerald Rapids briefings and it's quite clear why considering the enormous performance gains for AMX-enabled AI software.


Related Articles
Ampere Computing 2024 Roadmap Update: 256 Core 3nm CPU In 2025
Benchmarking The First RISC-V Cloud Server: Scaleway EM-RV1 Performance
AMD Announces Ryzen PRO 8840 & PRO 8000G Series CPUs
Intel Announces Gaudi 3 AI Accelerator, Intel Xeon 6 Brand
AMD Zen 4 vs. Zen 4C Performance, Zen 4C Core Scaling With Ryzen 5 8500G
Intel Core i3 14100 / i5 14500 vs. AMD Ryzen 5 8500G / 8600G In 500+ Benchmarks