Phoronix Forums  

Go Back   Phoronix Forums > Phoronix > Phoronix Test Suite

Phoronix Test Suite Discussion & collaboration on the Phoronix Test Suite software and specification.

Reply
 
Thread Tools Display Modes
  #1  
Old 04-02-2008, 10:40 AM
phoronix phoronix is offline
Phoronix News Bot
 
Join Date: Jan 2007
Posts: 3,103
Default Phoronix Test Suite Released

Phoronix: Phoronix Test Suite Released

Back in early February we announced that we were in the process of formalizing and releasing our internal test tools as a platform for facilitating easy to use, accurate, and reproducible Linux benchmarks based upon the testing work that we have been doing at Phoronix for the past four years. The goals with this are really to make it easier for Linux end-users to run reliable (both qualitative and quantitative) benchmarks for their own personal use, push more open-source projects to making their software more testable, and pushing hardware and software vendors for greater Linux testing based upon a standardized set of tests. Today we are very pleased to announce the first public release of the Phoronix Test Suite software, which is licensed under the GNU GPLv3, and the creation of a public database for freely sharing your test results and other information in a collaborative manner.

http://www.phoronix.com/vr.php?view=12136
Reply With Quote
  #2  
Old 04-02-2008, 12:41 PM
deanjo deanjo is online now
Senior Member
 
Join Date: May 2007
Posts: 2,928
Default

1st Bug found.


./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean
Enter a unique identifier for distinguishing this series of tests: 2

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================
PHP Fatal error: Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
dean@linux:~/Desktop/phoronix-test-suite>
Reply With Quote
  #3  
Old 04-02-2008, 12:45 PM
d2kx d2kx is offline
Senior Member
 
Join Date: Jan 2007
Location: Germany
Posts: 1,066
Default

Will give it a try later today or tomorrow! I have waited for the release for some time now, because I also wanted to do some comparions between drivers/distributions. Thanks for your great work, Michael
Reply With Quote
  #4  
Old 04-02-2008, 12:47 PM
Michael Michael is offline
Phoronix
 
Join Date: Jun 2006
Location: United States
Posts: 4,561
Default

deanjo:

Do you have time installed at all? If so, what path is it in (which time)?

Also, what version of PHP are you using / what distro (where bc math wouldn't be enabled)?
Reply With Quote
  #5  
Old 04-02-2008, 12:51 PM
Michael Michael is offline
Phoronix
 
Join Date: Jun 2006
Location: United States
Posts: 4,561
Default

Also, deanjo, if you run phoronix-test-suite benchmark nexuiz or another profile not depending upon the time command, it should work fine.
Reply With Quote
  #6  
Old 04-02-2008, 12:52 PM
deanjo deanjo is online now
Senior Member
 
Join Date: May 2007
Posts: 2,928
Default

openSUSE 11A3 / openSUSE 10.3 x64

yes time is installed in usr/bin/

PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)


BTW the time not being found only occurs in the audio encoding part of the tests.

Last edited by deanjo; 04-02-2008 at 12:55 PM.
Reply With Quote
  #7  
Old 04-02-2008, 01:01 PM
deanjo deanjo is online now
Senior Member
 
Join Date: May 2007
Posts: 2,928
Default

Quote:
Originally Posted by deanjo View Post
openSUSE 11A3 / openSUSE 10.3 x64

yes time is installed in usr/bin/

PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)


BTW the time not being found only occurs in the audio encoding part of the tests.

Sorry jumped the gun, the only tests that complete successfully are the Mplayer, PHP and Imagemagik, everything else fails.

Code:
dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean
Enter a unique identifier for distinguishing this series of tests: 2

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================
PHP Fatal error:  Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean 2
Enter a unique identifier for distinguishing this series of tests:
Enter a unique identifier for distinguishing this series of tests: 2

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Results:

 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Ogg Encoding Results:

 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
FLAC Audio Encoding Results:

 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
MPlayer Build Time: 10.59 Seconds

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Timed MPlayer Compilation Results:

10.59 Seconds

Average: 10.59 Seconds
=================================

=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4  (found: 2.5.35)
configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
PHP Build Time: 89.84 Seconds

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Timed PHP Compilation Results:

89.84 Seconds

Average: 89.84 Seconds
=================================

=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
ImageMagick Build Time: 173.93 Seconds

=================================
Executing Post-Benchmark Tasks
=================================

=================================
ImageMagick Compilation Results:

173.93 Seconds

Average: 173.93 Seconds
=================================

=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory

=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory

=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory

=================================
Nexuiz Results:

 Average FPS
 Average FPS
 Average FPS

Average: 0.00 Average FPS
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory

=================================
Executing Post-Benchmark Tasks
=================================

=================================
Time Gzip Compression Results:

 Seconds
 Seconds
 Seconds
 Seconds
 Seconds

Average: 0.00 Seconds
=================================
sh: lspci: command not found
sh: lspci: command not found
Results Saved To: test-results/dean2.xml
Do you want to view the results in your web browser (Y/n)? Y
Reply With Quote
  #8  
Old 04-02-2008, 01:05 PM
Michael Michael is offline
Phoronix
 
Join Date: Jun 2006
Location: United States
Posts: 4,561
Default

I'll get that fixed shortly... just physically adding in the line breaks.
Reply With Quote
  #9  
Old 04-02-2008, 01:28 PM
Michael Michael is offline
Phoronix
 
Join Date: Jun 2006
Location: United States
Posts: 4,561
Default

I just re-uploaded the 0.1 release with the corrected scripts for you. So just go re-download the package (or checkout the git) and then re-run it and it should be working for you with all tests I believe. You don't need to delete pts-benchmark-env as the Phoronix Test Suite will auto-detect these script changes.
Reply With Quote
  #10  
Old 04-02-2008, 02:31 PM
dm0rais dm0rais is offline
Junior Member
 
Join Date: Mar 2008
Posts: 14
Default

Good job Michael.Gonna bench it after the work.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -5. The time now is 08:16 PM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
Copyright ©2004 - 2009 by Phoronix Media.