R, Go & Other New Benchmarks Added

For those relying upon the Phoronix Test Suite for your open-source, automated benchmark needs on Linux, BSD, Solaris, and other operating systems, a number of new test profiles were recently made available.

There are a number of new and updated test profiles available on OpenBenchmarking.org ahead of this month's Phoronix Test Suite 6.2 release.

The folks at Ceemple Software working on the Zapcc compiler have been using the Phoronix Test Suite and recently sent over nearly two dozen new compiler benchmarks. Among the ones reviewed and committed so far include:

Timed Eigen Compilation - Exactly as it sounds.

Timed Boost Interprocess Compilation - Exactly as it sounds, with the Zapcc developers interested in benchmarking their LLVM-based compiler under many different workloads.

Meanwhile, thanks to the folks at Intel's Open-Source Technology Center have yet again been working on some more test profiles for their PTS needs:

go-benchmark - Run some Go language benchmarks!

rbenchmark - If R performance is more your thing.

And in cooperation with them, have been the new system/ repository that's designed to test the system-supplied libraries/components as opposed to building the software under test from scratch within the test profile. Some of the initial system tests here include:

system/apache - See how your operating system's Apache HTTPD server compares to what's shipped by other platforms or when building it yourself.

system/compress-lzma - Does how your distribution compile LZMA affect the compression performance?

system/compress-pbzip2 - Ditto for PBZIP2.

system/gnupg - Testing the performance of your system's GnuPG.

system/sqlite - Testing the performance of your system's SQLite.

Meanwhile, yesterday I added clpeak for reporting the OpenCL peak performance capabilities.

These new tests should all work on existing versions of the Phoronix Test Suite once your OpenBenchmarking.org cache automatically refreshes (or if you've run PTS in the past 24 hours, simply run phoronix-test-suite openbenchmarking-refresh), but of course, I always recommend users run either the latest stable version or Phoronix-Test-Suite from GitHub.

If you want to get to developing your own test profiles, it's very easy with the Phoronix Test Suite. Simply look at some of the sample test profiles once deployed via ~/.phoronix-test-suite/test-profiles. There's also a chapter of this book Power and Performance: Software Analysis and Optimization by an Intel performance engineer on writing test profiles for our software. You can also contact us for any commercial test development needs or drop by the forums if you run into any questions on assembling your own test profiles. Here's a very basic example of what a raw test profile looks like: just some bash scripts and XML files.

As of this afternoon we are up to 650 test profiles available for users of the Phoronix Test Suite via OpenBenchmarking.org. Be sure to check out the new OpenBenchmarking.org site that's now in beta too, and let us know what you think. Stay tuned for more Phoronix Test Suite 6.2 and OpenBenchmarking.org developments this month.