Intel 5th Gen Xeon "Emerald Rapids" AVX-512 Performance

Written by Michael Larabel in Processors on 5 January 2024 at 10:35 AM EST. Page 4 of 5. 18 Comments.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. Emerald Rapids: AVX-512 On was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. Emerald Rapids: AVX-512 On was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. Emerald Rapids: AVX-512 On was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 64, Model: ResNet-50. Emerald Rapids: AVX-512 On was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 64, Model: ResNet-50. Emerald Rapids: AVX-512 On was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 64, Model: ResNet-50. Emerald Rapids: AVX-512 On was the fastest.

While AVX-512 started off with much criticism over power and thermal implications, the latest Intel (and AMD) server processors with AVX-512 continue showing off very meaningful gains and without those early pain points.

OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP32, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16-INT8, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.
OpenVINO benchmark with settings of Model: Age Gender Recognition Retail 0013 FP16-INT8, Device: CPU. Emerald Rapids: AVX-512 On was the fastest.

AVX-512 and AMX continue to be very impactful for Intel's OpenVINO AI toolkit.


Related Articles
Ampere Computing 2024 Roadmap Update: 256 Core 3nm CPU In 2025
Benchmarking The First RISC-V Cloud Server: Scaleway EM-RV1 Performance
AMD Announces Ryzen PRO 8840 & PRO 8000G Series CPUs
Intel Announces Gaudi 3 AI Accelerator, Intel Xeon 6 Brand
AMD Zen 4 vs. Zen 4C Performance, Zen 4C Core Scaling With Ryzen 5 8500G
Intel Core i3 14100 / i5 14500 vs. AMD Ryzen 5 8500G / 8600G In 500+ Benchmarks