Phoronix Test Suite Released

[phoronix]

Phoronix: Phoronix Test Suite Released

Back in early February we announced that we were in the process of formalizing and releasing our internal test tools as a platform for facilitating easy to use, accurate, and reproducible Linux benchmarks based upon the testing work that we have been doing at Phoronix for the past four years. The goals with this are really to make it easier for Linux end-users to run reliable (both qualitative and quantitative) benchmarks for their own personal use, push more open-source projects to making their software more testable, and pushing hardware and software vendors for greater Linux testing based upon a standardized set of tests. Today we are very pleased to announce the first public release of the Phoronix Test Suite software, which is licensed under the GNU GPLv3, and the creation of a public database for freely sharing your test results and other information in a collaborative manner.

http://www.phoronix.com/vr.php?view=12136

[deanjo]

1st Bug found.


./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean
Enter a unique identifier for distinguishing this series of tests: 2

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================
PHP Fatal error: Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
dean@linux:~/Desktop/phoronix-test-suite>

[d2kx]

Will give it a try later today or tomorrow! I have waited for the release for some time now, because I also wanted to do some comparions between drivers/distributions. Thanks for your great work, Michael

[Michael]

deanjo:

Do you have time installed at all? If so, what path is it in (which time)?

Also, what version of PHP are you using / what distro (where bc math wouldn't be enabled)?

[Michael]

Also, deanjo, if you run phoronix-test-suite benchmark nexuiz or another profile not depending upon the time command, it should work fine.

[deanjo]

openSUSE 11A3 / openSUSE 10.3 x64

yes time is installed in usr/bin/

PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)


BTW the time not being found only occurs in the audio encoding part of the tests.

[deanjo]

openSUSE 11A3 / openSUSE 10.3 x64

yes time is installed in usr/bin/

PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)


BTW the time not being found only occurs in the audio encoding part of the tests.

Sorry jumped the gun, the only tests that complete successfully are the Mplayer, PHP and Imagemagik, everything else fails.

dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean
Enter a unique identifier for distinguishing this series of tests: 2

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================
PHP Fatal error:  Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean 2
Enter a unique identifier for distinguishing this series of tests:
Enter a unique identifier for distinguishing this series of tests: 2

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Results:

 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Ogg Encoding Results:

 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
FLAC Audio Encoding Results:

 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
MPlayer Build Time: 10.59 Seconds

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Timed MPlayer Compilation Results:

10.59 Seconds

Average: 10.59 Seconds
=================================

=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4  (found: 2.5.35)
configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
PHP Build Time: 89.84 Seconds

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Timed PHP Compilation Results:

89.84 Seconds

Average: 89.84 Seconds
=================================

=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
ImageMagick Build Time: 173.93 Seconds

=================================
Executing Post-Benchmark Tasks
=================================

=================================
ImageMagick Compilation Results:

173.93 Seconds

Average: 173.93 Seconds
=================================

=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory

=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory

=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory

=================================
Nexuiz Results:

 Average FPS
 Average FPS
 Average FPS

Average: 0.00 Average FPS
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Time Gzip Compression Results:

 Seconds
 Seconds
 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================
sh: lspci: command not found
sh: lspci: command not found
Results Saved To: test-results/dean2.xml
Do you want to view the results in your web browser (Y/n)? Y

[Michael]

I'll get that fixed shortly... just physically adding in the line breaks.

[Michael]

I just re-uploaded the 0.1 release with the corrected scripts for you. So just go re-download the package (or checkout the git) and then re-run it and it should be working for you with all tests I believe. You don't need to delete pts-benchmark-env as the Phoronix Test Suite will auto-detect these script changes.

[dm0rais]

Good job Michael.Gonna bench it after the work.