Intel 5th Gen Xeon Performance Benchmarks: Impressive Efficiency Gains With "Optimized Power Mode"

Written by Michael Larabel in Processors on 18 December 2023 at 10:00 AM EST. Page 5 of 6. 21 Comments.
Liquid-DSP benchmark with settings of Threads: 32, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 32, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 32, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 64, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 64, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 64, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 256, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 256, Buffer Length: 256, Filter Length: 512. Default was the fastest.
Liquid-DSP benchmark with settings of Threads: 256, Buffer Length: 256, Filter Length: 512. Default was the fastest.

Here's the Liquid-DSP digital signal processing library running at different thread counts to show the impact on differing power use as the CPU server utilization increased.

Redis benchmark with settings of Test: SET, Parallel Connections: 50. Default was the fastest.
Redis benchmark with settings of Test: SET, Parallel Connections: 50. Default was the fastest.
Redis benchmark with settings of Test: SET, Parallel Connections: 50. Default was the fastest.
Redis benchmark with settings of Test: GET, Parallel Connections: 500. Default was the fastest.
Redis benchmark with settings of Test: GET, Parallel Connections: 500. Default was the fastest.
Redis benchmark with settings of Test: GET, Parallel Connections: 500. Default was the fastest.

Redis workloads tended to benefit nicely from the Optimized Power Mode for greatly enhancing the power efficiency of 5th Gen Xeon.

PostgreSQL benchmark with settings of Scaling Factor: 100, Clients: 1000, Mode: Read Write. Default was the fastest.
PostgreSQL benchmark with settings of Scaling Factor: 100, Clients: 1000, Mode: Read Write, Average Latency. Default was the fastest.
PostgreSQL benchmark with settings of Scaling Factor: 100, Clients: 1000, Mode: Read Write, Average Latency. Default was the fastest.

Workloads like PostgreSQL that can be quite variable in their resource utilization also saw some nice power savings with Emerald Rapid's Optimized Power Mode.

OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. Optimized Power Mode was the fastest.
OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. Optimized Power Mode was the fastest.
OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. Optimized Power Mode was the fastest.
OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. Optimized Power Mode was the fastest.
OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. Default was the fastest.
OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. Default was the fastest.
OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. Default was the fastest.
OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. Default was the fastest.
OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16-INT8, Device: CPU. Default was the fastest.
OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16-INT8, Device: CPU. Default was the fastest.

The OpenVINO AI toolkit from Intel benefited to some extent too from the new Optimized Power Mode option for lowering CPU power use and in turn providing measurable improvements to power efficiency.

nginx benchmark with settings of Connections: 1000. Default was the fastest.
nginx benchmark with settings of Connections: 1000. Default was the fastest.
nginx benchmark with settings of Connections: 1000. Default was the fastest.

In the case of the Nginx web server workload the Optimized Power Mode didn't end up being really beneficial in that the performance hit was heavier and in turn leveled out the performance-per-Watt between the tested modes.


Related Articles
Ampere Computing 2024 Roadmap Update: 256 Core 3nm CPU In 2025
Benchmarking The First RISC-V Cloud Server: Scaleway EM-RV1 Performance
AMD Announces Ryzen PRO 8840 & PRO 8000G Series CPUs
Intel Announces Gaudi 3 AI Accelerator, Intel Xeon 6 Brand
AMD Zen 4 vs. Zen 4C Performance, Zen 4C Core Scaling With Ryzen 5 8500G
Intel Core i3 14100 / i5 14500 vs. AMD Ryzen 5 8500G / 8600G In 500+ Benchmarks