System76 Thelio Major Powered By AMD Ryzen Threadripper 7000 Series Performance

Written by Michael Larabel in Computers on 18 January 2024 at 11:00 AM EST. Page 3 of 7. 31 Comments.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.
OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.

Right off the bat with some AI benchmarking via the wonderful Intel OpenVINO AI toolkit, there's several interesting takeaways. First of all, the Threadripper 7980X performance with the new System76 Thelio Major is outright incredibly faster than the System76 Thelio Major from just four years ago... Throughput approaching 5x greater! As outlined in prior Zen 4 Threadripper testing, even being at the same core counts as the 3990X, the AVX-512 support, DDR5 memory, and other architectural improvements with AMD Zen 3 and Zen 4 are to thank. It was also interesting to see the System76 Thelio outperforming my DIY build using the Threadripper 7980X review kit.

OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.

When looking at the peak CPU frequency, we see the System76 Thelio Major was averaging a peak frequency of around 3.86GHz compared to the DIY (review kit) build at around 3.62GHz for this particular benchmark. This may be due to motherboard differences or other platform factors with the System76 Thelio performing slightly better.

OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.

The System76 Thelio and DIY builds of the Threadripper 7980X tended to be fairly similar for CPU core temperatures during OpenVINO.

OpenVINO benchmark with settings of Model: Age Gender Recognition Retail 0013 FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.
OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.
OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.
OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. TR 7980X DIY Build was the fastest.
OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.
OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16-INT8, Device: CPU. TR 7980X System76 Thelio was the fastest.

Across other OpenVINO benchmarks the System76 Thelio continued to match or outperform the DIY build, while also showing the huge progress AMD Ryzen Threadripper has made over the past four years.

TensorFlow benchmark with settings of Device: CPU, Batch Size: 1, Model: ResNet-50. TR 7980X DIY Build was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. TR 7980X DIY Build was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. TR 7980X DIY Build was the fastest.
TensorFlow benchmark with settings of Device: CPU, Batch Size: 16, Model: ResNet-50. TR 7980X DIY Build was the fastest.

In the TensorFlow ResNet-50 benchmarks the DIY build was slightly faster than the System76 Thelio, which likely comes down to the DDR5-4800 vs. DDR5-6400 difference from other testing I've conducted. For those that may be on a 3~5 year old workstation and only recently diving into AI, these results show the huge benefits to raw performance and power efficiency that are now possible with the latest Ryzen Threadripper processors.


Related Articles