View Full Version : Phoronix Test Suite Released
phoronix
04-02-2008, 09:40 AM
Phoronix: Phoronix Test Suite Released
Back in early February we announced that we were in the process of formalizing and releasing our internal test tools as a platform for facilitating easy to use, accurate, and reproducible Linux benchmarks based upon the testing work that we have been doing at Phoronix for the past four years. The goals with this are really to make it easier for Linux end-users to run reliable (both qualitative and quantitative) benchmarks for their own personal use, push more open-source projects to making their software more testable, and pushing hardware and software vendors for greater Linux testing based upon a standardized set of tests. Today we are very pleased to announce the first public release of the Phoronix Test Suite software, which is licensed under the GNU GPLv3, and the creation of a public database for freely sharing your test results and other information in a collaborative manner.
http://www.phoronix.com/vr.php?view=12136
deanjo
04-02-2008, 11:41 AM
1st Bug found.
./phoronix-test-suite benchmark universe
Installing Benchmarks For Universe Test Suite...
Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean
Enter a unique identifier for distinguishing this series of tests: 2
Phoronix Test Suite will record results!
=================================
Universe Test Suite
=================================
Running Benchmarks For Universe Test Suite...
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Executing Post-Benchmark Tasks
=================================
PHP Fatal error: Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
dean@linux:~/Desktop/phoronix-test-suite>
Will give it a try later today or tomorrow! I have waited for the release for some time now, because I also wanted to do some comparions between drivers/distributions. Thanks for your great work, Michael :)
Michael
04-02-2008, 11:47 AM
deanjo:
Do you have time installed at all? If so, what path is it in (which time)?
Also, what version of PHP are you using / what distro (where bc math wouldn't be enabled)?
Michael
04-02-2008, 11:51 AM
Also, deanjo, if you run phoronix-test-suite benchmark nexuiz or another profile not depending upon the time command, it should work fine.
deanjo
04-02-2008, 11:52 AM
openSUSE 11A3 / openSUSE 10.3 x64
yes time is installed in usr/bin/
PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)
BTW the time not being found only occurs in the audio encoding part of the tests.
deanjo
04-02-2008, 12:01 PM
openSUSE 11A3 / openSUSE 10.3 x64
yes time is installed in usr/bin/
PHP version 5.2.5-47 (fixed the PHP math error had to install the PHP5-bcmath module)
BTW the time not being found only occurs in the audio encoding part of the tests.
Sorry jumped the gun, the only tests that complete successfully are the Mplayer, PHP and Imagemagik, everything else fails.
dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe
Installing Benchmarks For Universe Test Suite...
Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean
Enter a unique identifier for distinguishing this series of tests: 2
Phoronix Test Suite will record results!
=================================
Universe Test Suite
=================================
Running Benchmarks For Universe Test Suite...
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Executing Post-Benchmark Tasks
=================================
PHP Fatal error: Call to undefined function bcdiv() in /home/dean/Desktop/phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175
dean@linux:~/Desktop/phoronix-test-suite> ./phoronix-test-suite benchmark universe
Installing Benchmarks For Universe Test Suite...
Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: dean 2
Enter a unique identifier for distinguishing this series of tests:
Enter a unique identifier for distinguishing this series of tests: 2
Phoronix Test Suite will record results!
=================================
Universe Test Suite
=================================
Running Benchmarks For Universe Test Suite...
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: ./lame: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Executing Post-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Results:
Seconds
Seconds
Seconds
Average: 0.00 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
sh: ./oggenc: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Ogg Encoding Results:
Seconds
Seconds
Seconds
Average: 0.00 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
sh: ./flac: /bin/sh\n/usr/bin/time: bad interpreter: No such file or directory
=================================
Executing Post-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Results:
Seconds
Seconds
Seconds
Average: 0.00 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
MPlayer Build Time: 10.59 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Results:
10.59 Seconds
Average: 10.59 Seconds
=================================
=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4 (found: 2.5.35)
configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
PHP Build Time: 89.84 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed PHP Compilation Results:
89.84 Seconds
Average: 89.84 Seconds
=================================
=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
ImageMagick Build Time: 173.93 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
ImageMagick Compilation Results:
173.93 Seconds
Average: 173.93 Seconds
=================================
=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory
=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory
=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
sh: ./nexuiz: /bin/sh\ncd: bad interpreter: No such file or directory
=================================
Nexuiz Results:
Average FPS
Average FPS
Average FPS
Average: 0.00 Average FPS
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
sh: ./compress-gzip: /bin/sh\ncp: bad interpreter: No such file or directory
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Time Gzip Compression Results:
Seconds
Seconds
Seconds
Seconds
Seconds
Average: 0.00 Seconds
=================================
sh: lspci: command not found
sh: lspci: command not found
Results Saved To: test-results/dean2.xml
Do you want to view the results in your web browser (Y/n)? Y
Michael
04-02-2008, 12:05 PM
I'll get that fixed shortly... just physically adding in the line breaks.
Michael
04-02-2008, 12:28 PM
I just re-uploaded the 0.1 release with the corrected scripts for you. So just go re-download the package (or checkout the git) and then re-run it and it should be working for you with all tests I believe. You don't need to delete pts-benchmark-env as the Phoronix Test Suite will auto-detect these script changes.
dm0rais
04-02-2008, 01:31 PM
Good job Michael.Gonna bench it after the work.
deanjo
04-02-2008, 01:51 PM
Well Michael, the audio tests do now work. The Mplayer compile time is a bit unrealistic though and other tests still have errors.
=================================
Universe Test Suite
=================================
Running Benchmarks For Universe Test Suite...
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
WAV To MP3 Encode Time: 22.11 Seconds
=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
WAV To MP3 Encode Time: 21.26 Seconds
=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
WAV To MP3 Encode Time: 21.28 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Results:
22.11 Seconds
21.26 Seconds
21.28 Seconds
Average: 21.55 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
WAV To OGG Encode Time: 9.63 Seconds
=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
WAV To OGG Encode Time: 8.40 Seconds
=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
WAV To OGG Encode Time: 8.44 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Ogg Encoding Results:
9.63 Seconds
8.40 Seconds
8.44 Seconds
Average: 8.82 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
WAV To FLAC Encode Time: 5.62 Seconds
=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
WAV To FLAC Encode Time: 5.07 Seconds
=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
WAV To FLAC Encode Time: 5.26 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Results:
5.62 Seconds
5.07 Seconds
5.26 Seconds
Average: 5.31 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
MPlayer Build Time: 20.13 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Results:
20.13 Seconds
Average: 20.13 Seconds
=================================
=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4 (found: 2.5.35)
configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
PHP Build Time: 89.76 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed PHP Compilation Results:
89.76 Seconds
Average: 89.76 Seconds
=================================
=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
ImageMagick Build Time: 167.44 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
ImageMagick Compilation Results:
167.44 Seconds
Average: 167.44 Seconds
=================================
=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Results:
Average FPS
Average FPS
Average FPS
Average: 0.00 Average FPS
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Time Gzip Compression Results:
Seconds
Seconds
Seconds
Seconds
Seconds
Average: 0.00 Seconds
=================================
sh: lspci: command not found
sh: lspci: command not found
Results Saved To: test-results/mytest2.xml
Do you want to view the results in your web browser (Y/n)? Y
dean@linux:~/Desktop/phoronix-test-suite>
the lspci also requires to be ran in root.
Ole-Martin Broz
04-02-2008, 02:37 PM
Ehm, guys, trondheim means norwegian town name, which got nidarosdomen and people with funny accent wich calls every1 for horsecock ?
all the above is correct. not often i see norwegian names in codenames.
Anyways cant wait to test it!
Michael
04-02-2008, 02:39 PM
Well Michael, the audio tests do now work. The Mplayer compile time is a bit unrealistic though and other tests still have errors.
=================================
Universe Test Suite
=================================
Running Benchmarks For Universe Test Suite...
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
WAV To MP3 Encode Time: 22.11 Seconds
=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
WAV To MP3 Encode Time: 21.26 Seconds
=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
WAV To MP3 Encode Time: 21.28 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Results:
22.11 Seconds
21.26 Seconds
21.28 Seconds
Average: 21.55 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
WAV To OGG Encode Time: 9.63 Seconds
=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
WAV To OGG Encode Time: 8.40 Seconds
=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
WAV To OGG Encode Time: 8.44 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Ogg Encoding Results:
9.63 Seconds
8.40 Seconds
8.44 Seconds
Average: 8.82 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
WAV To FLAC Encode Time: 5.62 Seconds
=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
WAV To FLAC Encode Time: 5.07 Seconds
=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
WAV To FLAC Encode Time: 5.26 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Results:
5.62 Seconds
5.07 Seconds
5.26 Seconds
Average: 5.31 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
MPlayer Build Time: 20.13 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Results:
20.13 Seconds
Average: 20.13 Seconds
=================================
=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4 (found: 2.5.35)
configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
PHP Build Time: 89.76 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed PHP Compilation Results:
89.76 Seconds
Average: 89.76 Seconds
=================================
=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
ImageMagick Build Time: 167.44 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
ImageMagick Compilation Results:
167.44 Seconds
Average: 167.44 Seconds
=================================
=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Results:
Average FPS
Average FPS
Average FPS
Average: 0.00 Average FPS
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
cp: target `bigfile' is not a directory
sh: -c: line 0: unexpected EOF while looking for matching ``'
sh: -c: line 2: syntax error: unexpected end of file
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Time Gzip Compression Results:
Seconds
Seconds
Seconds
Seconds
Seconds
Average: 0.00 Seconds
=================================
sh: lspci: command not found
sh: lspci: command not found
Results Saved To: test-results/mytest2.xml
Do you want to view the results in your web browser (Y/n)? Y
dean@linux:~/Desktop/phoronix-test-suite>
the lspci also requires to be ran in root.
Hmmm mplayer does seem to be a problem for you. Have you tried building it manually to see what it's erroring out on?
There's another compress-gzip fix in the git code.
Latest code .tar.gz download: http://phorogit.com/index.php?p=phoronix-test-suite.git&dl=targz
Michael
04-02-2008, 02:50 PM
all the above is correct. not often i see norwegian names in codenames.
Anyways cant wait to test it!
Hei. Yeah I know Trondheim is a Norwegian town name.. I've been there. I was asked by one my closed testers what the 1.0 codename shall be, and I hadn't thought of one.... Trying to think of something that doesn't start with phor* (:)) and no names that are remotely close to any recent FOSS project code-names, Trondheim came to mind as a name as a good chunk of it was written while I was there on business.
deanjo
04-02-2008, 02:55 PM
Have you tried building it manually to see what it's erroring out on?
No errors, builds fine with ./configure && make
aerosquid
04-02-2008, 02:58 PM
Is there a doc detailing install steps somewhere? I have the latest php5-cli installed but i'm not having any luck running the benchmarks.
Michael
04-02-2008, 03:00 PM
No errors, builds fine with ./configure && make
Hmmm odd as all it's doing is just:
rm -rf MPlayer-1.0rc2/
tar -xjf mplayer.tar.bz2
cd MPlayer-1.0rc2/
./configure > /dev/null
sleep 3
/usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds
Michael
04-02-2008, 03:01 PM
Is there a doc detailing install steps somewhere? I have the latest php5-cli installed but i'm not having any luck running the benchmarks.
Where are you getting stuck? The article provides pretty much all of the documentation, but once you have php5-cli and build-essential installed, just:
- extract the .tar.gz
- cd to it
- run ./phoronix-test-suite to see all arguments
- run ./phoronix-test-suite benchmark universe to run all of the benchmarks.
That's really it.... It's meant to be easy :D (well, once all bugs have been squashed)
bugmenot
04-02-2008, 03:14 PM
Hello, great news!
This error appears very often:
Warning: file_get_contents(/etc/lsb-release): failed to open stream: No such file or directory in /home/x/Desktop/phoronix-test-suite/pts-core/functions/pts-functions_linux.php on line 60
And a Do you want to view the results in your web browser (Y/n)? Y opens firefox instead of my standard gnome browser epiphany here.
Using an up-to-date Debian SID.
Thanks!
edit: and when starting the phoronix test suite as root should be a question if you relly want that in order to avoid a root owned test-results folder which is hard to remove by hand for an end-user.
deanjo
04-02-2008, 03:15 PM
Well Gzip now works, nexuiz still has issues as does mplayer.
./phoronix-test-suite benchmark universe
Installing Benchmarks For Universe Test Suite...
Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
=================================
Installing Benchmark: compress-gzip
=================================
pts-wav-sample-file.wav
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: test3
Enter a unique identifier for distinguishing this series of tests: 1
Phoronix Test Suite will record results!
=================================
Universe Test Suite
=================================
Running Benchmarks For Universe Test Suite...
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
WAV To MP3 Encode Time: 22.34 Seconds
=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
WAV To MP3 Encode Time: 21.27 Seconds
=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
WAV To MP3 Encode Time: 21.35 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
LAME MP3 Encoding Results:
22.34 Seconds
21.27 Seconds
21.35 Seconds
Average: 21.65 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
WAV To OGG Encode Time: 9.53 Seconds
=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
WAV To OGG Encode Time: 8.40 Seconds
=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
WAV To OGG Encode Time: 8.40 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Ogg Encoding Results:
9.53 Seconds
8.40 Seconds
8.40 Seconds
Average: 8.77 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
WAV To FLAC Encode Time: 6.39 Seconds
=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
WAV To FLAC Encode Time: 5.08 Seconds
=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
WAV To FLAC Encode Time: 5.08 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
FLAC Audio Encoding Results:
6.39 Seconds
5.08 Seconds
5.08 Seconds
Average: 5.51 Seconds
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
MPlayer Build Time: 20.48 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed MPlayer Compilation Results:
20.48 Seconds
Average: 20.48 Seconds
=================================
=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
configure: warning: You will need re2c 0.12.0 or later if you want to regenerate PHP parsers.
configure: warning: flex versions supported for regeneration of the Zend/PHP parsers: 2.5.4 (found: 2.5.35)
configure: warning: lemon versions supported for regeneration of libsqlite parsers: 1.0 (found: none).
PHP Build Time: 88.51 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Timed PHP Compilation Results:
88.51 Seconds
Average: 88.51 Seconds
=================================
=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
ImageMagick Build Time: 169.15 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
ImageMagick Compilation Results:
169.15 Seconds
Average: 169.15 Seconds
=================================
=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: No such file or directory
./nexuiz-linux-glx.sh: line 121: /home/dean/pts-benchmark-env/nexuiz/Nexuiz/nexuiz-linux-x86_64-glx: Success
=================================
Nexuiz Results:
Average FPS
Average FPS
Average FPS
Average: 0.00 Average FPS
=================================
=================================
Executing Pre-Benchmark Tasks
=================================
=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
Gzip Compress Time: 41.70 Seconds
=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
Gzip Compress Time: 40.86 Seconds
=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
Gzip Compress Time: 43.46 Seconds
=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
Gzip Compress Time: 41.05 Seconds
=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
Gzip Compress Time: 41.64 Seconds
=================================
Executing Post-Benchmark Tasks
=================================
=================================
Time Gzip Compression Results:
41.70 Seconds
40.86 Seconds
43.46 Seconds
41.05 Seconds
41.64 Seconds
Average: 41.74 Seconds
=================================
sh: lspci: command not found
sh: lspci: command not found
Results Saved To: test-results/test3.xml
Do you want to view the results in your web browser (Y/n)? Y
Would you like to upload these results to PTS Global (Y/n)? n
Michael
04-02-2008, 03:52 PM
Hello, great news!
This error appears very often:
Warning: file_get_contents(/etc/lsb-release): failed to open stream: No such file or directory in /home/x/Desktop/phoronix-test-suite/pts-core/functions/pts-functions_linux.php on line 60
And a Do you want to view the results in your web browser (Y/n)? Y opens firefox instead of my standard gnome browser epiphany here.
Using an up-to-date Debian SID.
Thanks!
edit: and when starting the phoronix test suite as root should be a question if you relly want that in order to avoid a root owned test-results folder which is hard to remove by hand for an end-user.
Regarding the error, that has been fixed in git.
The most recent git commit has checking implemented to ensure that if the object doesn't exist, no error will be created but will just show "Unknown". This includes the deanjo lspci errors too.
Regarding the browser, right now it defaults to Firefox as browser checking isn't yet implemented.
aerosquid
04-02-2008, 04:03 PM
Where are you getting stuck? The article provides pretty much all of the documentation, but once you have php5-cli and build-essential installed, just:
- extract the .tar.gz
- cd to it
- run ./phoronix-test-suite to see all arguments
- run ./phoronix-test-suite benchmark universe to run all of the benchmarks.
That's really it.... It's meant to be easy :D (well, once all bugs have been squashed)
got it :D
Thanks!
Max Spain
04-02-2008, 05:27 PM
I really like where this is going :) I just installed, ran, and uploaded a nexuiz benchmark and it worked great. I would like to suggest the ability for users to add comments. Many kudos :cool:
Michael
04-02-2008, 05:31 PM
I really like where this is going :) I just installed, ran, and uploaded a nexuiz benchmark and it worked great. I would like to suggest the ability for users to add comments. Many kudos :cool:
Comments are already planned once user registration is turned back on :)
Michael, you certainly win at user-friendliness.
Can't wait 'till the GUI is done, that'll be awesome - mortal humans be able to do the basic ego inflation! :)
Michael
04-02-2008, 06:45 PM
The thread for the (now fixed) sh problem has been moved to: http://phoronix.com/forums/showthread.php?t=8750
Melcar
04-02-2008, 08:07 PM
Works fine for me :). One thing I have noticed however... when running the Graphics test, the Doom time demo suffers from short 2-3sec. pauses; this does not happen if I run the time demo from my own Doom 3 install, and I even get a higher score (118fps compared to 71fps on the test suite).
Michael
04-02-2008, 08:11 PM
Melcar: the id software profiles are in a poor state right now... Haven't had much time yet to focus on those.
Michael
04-02-2008, 10:01 PM
In the latest git code, the dependency on bcmath should be dropped now.
There is also a new memory benchmarking and CPU cache profile (memory-benchmark).
Thetargos
04-03-2008, 03:34 AM
I won't be able to test the system on my systems until the weekend, but thus far this looks VERY interesting. I have a few questions about some parts of the implementation, though:
How are you planning to deal with root-specific tasks such as hdparm and detailed information on lspci?
What other graphics applications do you plan to support?
Do you envision some sort of dedicated 3D "demo" application to be used specifically with the suite to not depend on other external apps?
Wow, I have so many more questions, but I'll just wait until I test the suite in my systems.
Thank you Michael, really. This was something needed long ago... Not that synthetic benchmarks matter (a la MadOnion) much, but that certainly gives a common and OPEN base for comparison of several systems and components to give a very good glimpse of what can you expect from any given hardware in Linux. What's more, unlike the above mentioned site this project may not only draw more attention towards Linux from IHVs, but also encourage Open Source driver developers to optimize and maybe increase the developer base for open drivers. This is very exciting!
Dandel
04-03-2008, 06:43 AM
I tried it a few times, the results didn't save for a few results due to not being able to fully regenerate the scripts... might be a good idea to add a test that checks for the dependencies of the build tests, especially since each system has different packages and it will effect the accuracy of the results... just try compiling php when you don't have bison installed, and you'll see what i mean.
Michael
04-03-2008, 06:50 AM
How are you planning to deal with root-specific tasks such as hdparm and detailed information on lspci?
What other graphics applications do you plan to support?
Do you envision some sort of dedicated 3D "demo" application to be used specifically with the suite to not depend on other external apps?!
- Using gksu/kdesu I think is how we'll handle it.
- Tons of other graphics applications... Laminar Research should be contributing a profile for X-Plane plus we'll be making profiles or the developers themselves for practically every other benchmark-capable Linux graphics app out there.
- Can you elaborate on your third point?
Melcar
04-03-2008, 07:16 AM
- Using gksu/kdesu I think is how we'll handle it.
- Tons of other graphics applications... Laminar Research should be contributing a profile for X-Plane plus we'll be making profiles or the developers themselves for practically every other benchmark-capable Linux graphics app out there.
- Can you elaborate on your third point?
I think he means something like 3DMark. Instead of just having a bunch of in game time demos have a separate dedicated synthetic demo that tests specific graphical capabilities. Depending on in-game time demos implies a mixed result (CPU + GPU) which will not give an accurate picture of pure graphics performance. One needs to only look at the results on the PTS (C2Ds vs. X2s). Have a more GPU bound test.
Actually for the third point ("3D 'demo' application") I think one could take Nexuiz, strip out the not-so-demanding levels (leaving the levels with rain, reflective/refractive water, terrain etc. etc.) and unused music and come up with a much slimmer minimal version tailored towards torturing graphics card.
Sothing like that.
SavageX
04-03-2008, 07:21 AM
Actually for the third point ("3D 'demo' application") I think one could take Nexuiz, strip out the not-so-demanding levels (leaving the levels with rain, reflective/refractive water, terrain etc. etc.) and unused music and come up with a much slimmer minimal version tailored towards torturing graphics card.
Melcar
04-03-2008, 07:49 AM
Question. What's stopping the user from manually altering his/her results and then submitting that altered file to the PTS boards?
Michael
04-03-2008, 07:52 AM
Question. What's stopping the user from manually altering his/her results and then submitting that altered file to the PTS boards?
Nothing, just their own good will. With an open-source solution, that's a challenge to address and is why the results on PTS Global aren't displayed on the main page.
Michael
04-03-2008, 08:06 AM
Great new folks!
it looks like Lightsmark will be ported to Linux (very soon, according to the developer) and integrated with PTS.
http://dee.cz/lightsmark/
givemesugarr
04-03-2008, 08:43 AM
i was wondering if some gentooer that has created an ebuild for the suite or should i start creating one in my spare time?!
Doesn't the Specviewperf (I forget the proper name) do a good test? Michael is already familiar with it too.
Michael
04-03-2008, 08:57 AM
Vadi:
SPECViewPerf will have a profile soon... It's only issue is requiring csh and freeglut to build. To build freeglut you need a number of additional dependencies, so its quite a bit of scripting to get it all running within the PTS environment. However, for this profile it may need to rely upon the distribution's packaging system for now.
Sacha
04-03-2008, 08:59 AM
I try hdparm-read test on KDE (we don't have gksudo):
=================================
hdparm Timed Disk Reads Benchmark (Run 1 of 3)
=================================
./hdparm-su: 3: gksudo: not found
Root permission needed to run hdparm benchmark.
I try hdparm-read test using sudo:
Disk To Read:
1: First SATA Disk (sda)
2: Second SATA Disk (sdb)
3: Third SATA Disk (sdc)
Please Enter Your Choice: 1
This application executable could not be found in . or /root/pts-benchmark-env/hdparm-read/.
Benchmark terminating
RAMspeed test worked fine, but when I upload test, it says I achieved 0MB/s?
pierluc
04-03-2008, 09:30 AM
Can you create a tools to check what is the minimum and the recommanded requirement to play a Linux video-game?
Michael
04-03-2008, 09:33 AM
Sacha:
Working out some bugs in the RAMSpeed parsing, since it outputs four sets of results simultaneously as you can see. That will be fixed in the forthcoming 0.1.1 release.
hdparm is still to be addressed as it requires root access.
pierluc: We may evaluate that possibility, but I am sure most users with their current hardware would have no problems playing any of the recent games.
pierluc
04-03-2008, 10:58 AM
Yes, but in the future the Linux video games will be bigger and it will be useful. It's also more professional to give this informations on a a video game web site like http://www.jeuxlinux.fr/ .
deanjo
04-03-2008, 11:44 AM
Yes, but in the future the Linux video games will be bigger
We hope, every year we hear that but in reality there hasn't been any huge advancement in linux game publishing in years.
Some additional aspects (tested with current git snapshot):
a) You now require /usr/bin/time, that's ok, but then tell the ppl to install it if not present,
b) nexuiz install requires unzip, thats also not default
c) errors shown when compiling php: bison flex lemon are misssing, don't know if the compile really finishes or not, do you check errorlevel?
(a+b are usally installed on ubuntu - a because of dash as sh, bash uses time builtin).
A general problem is when you use the test in live mode: you run out of ram because yo do absolutely no cleanup. If you compiled a requirement then delete the sources (you can use --prefix=... and then make install), or delete what you compiled after you benched it. No need to keep those files.
Michael
04-04-2008, 07:57 AM
a. it will be more clear to users in next release.
b. yeah
c. It still compiles.
The scripts will be cleaned up more once pts-core is settled... However, patches are always welcome if others wish to clean them up too.
For all those interested, please check out the latest git and report back as there should be improved hardware and software detection (including distro name). Thanks,
pm124493
04-04-2008, 08:06 AM
I get the following error during suite initialization for benchmark games.
=================================
Installing Benchmark: quake4
=================================
--07:34:16-- ftp://ftp.idsoftware.com/idstuff/quake4/linux/quake4-linux-1.4.2.x86.run
=> `quake4-linux.run'
Resolving ftp.idsoftware.com... 192.246.40.185
Connecting to ftp.idsoftware.com|192.246.40.185|:21... connected.
Logging in as anonymous ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /idstuff/quake4/linux ... done.
==> PASV ... done. ==> RETR quake4-linux-1.4.2.x86.run ... done.
Length: 287,552,973 (274M) (unauthoritative)
100%[================================================== ================>] 287,552,973 91.79K/s ETA 00:00
08:26:56 (88.88 KB/s) - `quake4-linux.run' saved [287552973]
--08:26:56-- http://www.phoronix-test-suite.com/benchmark-files/quake4-demo-1.tar.bz2
=> `quake4-demo.tar.bz2'
Resolving www.phoronix-test-suite.com... 70.85.96.187
Connecting to www.phoronix-test-suite.com|70.85.96.187|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
08:26:56 ERROR 404: Not Found.
bzip2: Compressed file ends unexpectedly;
perhaps it is corrupted? *Possible* reason follows.
bzip2: Inappropriate ioctl for device
Input file = (stdin), output file = (stdout)
It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.
You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.
tar: Child returned status 2
tar: Error exit delayed from previous errors
mv: cannot stat `pts.demo': No such file or directory
Verifying archive integrity... All good.
Uncompressing Quake 4 (TM).............................................. .................................................. .................................................. .................................................. .................................................. .................................................. .................................................. .................................................. .................................................. .................................................. ......................
Quake 4 Game Files (*.pk4) Must Be Copied Into /root/pts-benchmark-env/quake4/q4base
Also Copy Your Game Key File To ~/.quake4/q4base/quake4key (If Not Already There)
I tried to go to benchmark directory, but it gets a 404.
Any help would be appreciated.
Pete
Regenwald
04-05-2008, 05:19 AM
yeah, good work. i have an off-topic question: how many developers have worked on it? just you michael or did you "enjoy" some external help?
Michael
04-05-2008, 05:46 AM
yeah, good work. i have an off-topic question: how many developers have worked on it? just you michael or did you "enjoy" some external help?
Up to this point it's just been me coding with the input of one other person, who wishes to remain anonymous at this time. However, there are a handful of companies now working to produce profiles for their software.
Regenwald
04-05-2008, 06:10 AM
nice, glad to hear that :)
bogdanbiv
04-06-2008, 01:01 PM
Can PTS be ever ported to Windows? MacOS?
A Windows port would gain:
+ comparable benchmark results between Linux/Windows
+ wider acceptance of the PTS as a test suite (due to the previous point)
Otherwise PTS will still be valuable for Linuxer's, but would not help Linux marketing efforts as it would still be dismissed by Windows users as a `Linux toy`.
Right now we should not have as an objective to replace established Windows benchmarks such as PC Mark / 3D Mark and this is no attempt at suggesting such a thing. I suppose PTS is too young for this kind of competition - and it will be for at least a couple of years.
So can we hope for some comparable benchmarks across platforms? Console, gui - whatever! How hard would it be to do?
No sarcasm included here. No reading between the lines, please, as I post in good faith.
I just want to check if others are interested in this idea, and I intend no push for features. Also I seek the opinion of programmers better than myself (that is almost any programmer :-) ) to estimate the porting effort.
Thanks.
UPDATE: I got my answer by carefully reading the article:
The only pre-requisites for the Phoronix Test Suite are that you are running Linux (though other operating systems could easily be supported) and that you have the standard development tools/libraries installed (so that the Phoronix Test Suite can compile any of the needed benchmarks) along with php5-cli.
Quote from the article page 2, second paragraph
Thanks again, Michael
bogdanbiv
04-06-2008, 01:25 PM
Up to this point it's just been me coding with the input of one other person, who wishes to remain anonymous at this time. However, there are a handful of companies now working to produce profiles for their software.
Michael, what kind of contributors do you need?
Oh, the part about companies is just marvelous.
Should those companies allow, you should start bragging about their support - I guess it would gain much more collaborators.
Michael
04-06-2008, 02:22 PM
Should those companies allow, you should start bragging about their support - I guess it would gain much more collaborators.
Some of the involved companies will be clear in the near future... At least one so far is going as far as releasing a special demo of their softwate that is specifically designed for use with the PTS.
Regenwald
04-06-2008, 03:27 PM
amd/ati..............(need 10 characters to send this message^^)
Michael
04-06-2008, 09:22 PM
So can we hope for some comparable benchmarks across platforms? Console, gui - whatever! How hard would it be to do?
It really wouldn't be hard to do at all since it runs atop the PHP5/Zend engine. It would more come down to compatibility issues with the profiles/test scripts as many of those cannot be built the same on Windows. Pts-core itself is very portable and just requires changing out the interface for reading the hardware/software attributes. While it would be a simple task, I just won't have the time to do it as my schedule is already bottlenecked.
Michael
04-06-2008, 09:23 PM
Michael, what kind of contributors do you need?
Testers just running it out with their different PC(s) when a new release is out or better yet using git frequently and reporting your feedback to the forums.
If you see an application lacking a profile, you could also write one yourself and submit it :) It's quite easy to do.
puntarenas
04-13-2008, 04:54 AM
I just wanted to say thank you, Michael! Great work and I really like the idea of profiles for suites and single benchmarks. :)
Dr_ST
04-21-2008, 03:37 PM
Nice work !!!
I would like to get the test running natively under Mandriva Spring (at least this version) .
I've already modified:
./pts/distro-scripts/install-mandriva-packages.sh
./pts/distro-xml/mandriva-packages.xml
In order to adjsut installation commands and packages name (close to fedora but not all).
I think i need something to modify, but could you guide me a little?
I'm a mandriva long-term contributor (9 years) and i really appreciate this testing suite, i'm there for providing full feeedbackk for the test suite (and of course some specifities to mandriva if needed). Are you OK with this addition?
Michael
04-21-2008, 03:50 PM
Nice work !!!
I would like to get the test running natively under Mandriva Spring (at least this version) .
I've already modified:
./pts/distro-scripts/install-mandriva-packages.sh
./pts/distro-xml/mandriva-packages.xml
In order to adjsut installation commands and packages name (close to fedora but not all).
I think i need something to modify, but could you guide me a little?
I'm a mandriva long-term contributor (9 years) and i really appreciate this testing suite, i'm there for providing full feeedbackk for the test suite (and of course some specifities to mandriva if needed). Are you OK with this addition?
Hi Dr_ST,
I'll be happy to push the Mandriva changes upstream once they're working.
That should be all the modifications that are needed to support the "PTS External Dependencies". Is it not working for you? If it's not, I think then it would be a problem in install-mandriva-packages.sh maybe, as it should be auto-detected just fine if the distribution name is being detected properly.
If that's the case, what's the output of phoronix-test-suite diagnostics? It will display something like:
=================================
Phoronix Test Suite v0.3.1 (TRONDHEIM)
Diagnostics Dump
=================================
PTS_VERSION = 0.3.1
PTS_CODENAME = TRONDHEIM
PTS_TYPE = DESKTOP
THIS_RUN_TIME = 1208810964
XML_PROFILE_LOCATION = pts/benchmark-profiles/
XML_SUITE_LOCATION = pts/benchmark-suites/
DISTRO_XML_LOCATION = pts/distro-xml/
DISTRO_SCRIPT_LOCATION = pts/distro-scripts/
BENCHMARK_RESOURCE_LOCATION = pts/benchmark-resources/
PTS_USER_DIR = /home/michael/.phoronix-test-suite/
BENCHMARK_ENVIRONMENT = /home/michael/pts-benchmark-env/
SAVE_RESULTS_LOCATION = /home/michael/pts-test-results/
Environmental Variables (accessible via test scripts):
PTS_TYPE = DESKTOP
PTS_VERSION = 0.3.1
NUM_CPU_CORES = 2
NUM_CPU_JOBS = 3
SYS_MEMORY = 1982
VIDEO_MEMORY = 512
VIDEO_WIDTH = 1680
VIDEO_HEIGHT = 1050
OS = Ubuntu
OS_VERSION = 8.04
OS_ARCH = x86_64
THIS_RUN_TIME = 1208810964
Then in the environmental variables, is the OS = showing "Mandriva" or something else? the name of the distro-packages.xml and install-distro-packages.sh is where distro is the lowercase version of OS.
Dr_ST
04-21-2008, 04:03 PM
If that's the case, what's the output of phoronix-test-suite diagnostics? It will display something like:
Nothing is displayed except the help file, i may need an update version of the test suite (0.3.1 actually)?
Michael
04-21-2008, 04:11 PM
You'll need to use the latest git.... .tar.gz of it @ http://www.phorogit.com/index.php?p=phoronix-test-suite.git&dl=targz This git also has a few more packages added in.
Dr_ST
04-21-2008, 04:22 PM
You'll need to use the latest git.... .tar.gz of it @ http://www.phorogit.com/index.php?p=phoronix-test-suite.git&dl=targz This git also has a few more packages added in.
Ok, then i have:
=================================
Phoronix Test Suite v0.3.1 (TRONDHEIM)
Diagnostics Dump
=================================
PTS_VERSION = 0.3.1
PTS_CODENAME = TRONDHEIM
PTS_TYPE = DESKTOP
THIS_RUN_TIME = 1208812589
XML_PROFILE_LOCATION = pts/benchmark-profiles/
XML_SUITE_LOCATION = pts/benchmark-suites/
DISTRO_XML_LOCATION = pts/distro-xml/
DISTRO_SCRIPT_LOCATION = pts/distro-scripts/
BENCHMARK_RESOURCE_LOCATION = pts/benchmark-resources/
PTS_USER_DIR = /home/stephane/.phoronix-test-suite/
BENCHMARK_ENVIRONMENT = /home/stephane/pts-benchmark-env/
SAVE_RESULTS_LOCATION = /home/stephane/pts-test-results/
Environmental Variables (accessible via test scripts):
PTS_TYPE = DESKTOP
PTS_VERSION = 0.3.1
NUM_CPU_CORES = 2
NUM_CPU_JOBS = 3
SYS_MEMORY = 3024
VIDEO_MEMORY = 256
VIDEO_WIDTH = 1280
VIDEO_HEIGHT = 800
OS = MandrivaLinux
OS_VERSION = 2008.1
OS_ARCH = x86_64
THIS_RUN_TIME = 1208812589
I have adjusted the name accordingly, now running the test, i've seen the gcc-c++ is missing from my modified file :-)
Do you want the modfied file now?
Michael
04-21-2008, 04:41 PM
If the files are working, sure. Michael [at] phoronix.com
Tares
04-24-2008, 11:24 AM
Well, sorry for a noob question, but I just cant get it working ;-) how to upload results for my account ? :)
EDIT :
okay, got that ;-) didn't read that I need the latest .tar.gz ;-)
vBulletin® v3.8.4, Copyright ©2000-2010, Jelsoft Enterprises Ltd.