System76 Thelio Major Powered By AMD Ryzen Threadripper 7000 Series Performance
Right off the bat with some AI benchmarking via the wonderful Intel OpenVINO AI toolkit, there's several interesting takeaways. First of all, the Threadripper 7980X performance with the new System76 Thelio Major is outright incredibly faster than the System76 Thelio Major from just four years ago... Throughput approaching 5x greater! As outlined in prior Zen 4 Threadripper testing, even being at the same core counts as the 3990X, the AVX-512 support, DDR5 memory, and other architectural improvements with AMD Zen 3 and Zen 4 are to thank. It was also interesting to see the System76 Thelio outperforming my DIY build using the Threadripper 7980X review kit.
When looking at the peak CPU frequency, we see the System76 Thelio Major was averaging a peak frequency of around 3.86GHz compared to the DIY (review kit) build at around 3.62GHz for this particular benchmark. This may be due to motherboard differences or other platform factors with the System76 Thelio performing slightly better.
The System76 Thelio and DIY builds of the Threadripper 7980X tended to be fairly similar for CPU core temperatures during OpenVINO.
Across other OpenVINO benchmarks the System76 Thelio continued to match or outperform the DIY build, while also showing the huge progress AMD Ryzen Threadripper has made over the past four years.
In the TensorFlow ResNet-50 benchmarks the DIY build was slightly faster than the System76 Thelio, which likely comes down to the DDR5-4800 vs. DDR5-6400 difference from other testing I've conducted. For those that may be on a 3~5 year old workstation and only recently diving into AI, these results show the huge benefits to raw performance and power efficiency that are now possible with the latest Ryzen Threadripper processors.