sh problem with phoronix-test-suite

[deanjo]

Regarding the error, that has been fixed in git.

The most recent git commit has checking implemented to ensure that if the object doesn't exist, no error will be created but will just show "Unknown". This includes the deanjo lspci errors too.

Regarding the browser, right now it defaults to Firefox as browser checking isn't yet implemented.

Using the latest Git now fails every test with


sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

[Michael]

Using the latest Git now fails every test with


sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file


If you run it with benchmark argument? Can you post the complete output?

[deanjo]

If you run it with benchmark argument? Can you post the complete output?

I wish I could but it exceeds the 10000 character limit of the forums.

[Michael]

I wish I could but it exceeds the 10000 character limit of the forums.


Email: michael [at] phoronix.com

[deanjo]

Part1

./phoronix-test-suite benchmark universe

Installing Benchmarks For Universe Test Suite...

Encode-mp3 is already installed, skipping installation routine...
Encode-ogg is already installed, skipping installation routine...
Encode-flac is already installed, skipping installation routine...
Build-mplayer is already installed, skipping installation routine...
Build-php is already installed, skipping installation routine...
Build-imagemagick is already installed, skipping installation routine...
Nexuiz is already installed, skipping installation routine...
Compress-gzip is already installed, skipping installation routine...
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: test5
Enter a unique identifier for distinguishing this series of tests: 1

Phoronix Test Suite will record results!

=================================
Universe Test Suite
=================================

Running Benchmarks For Universe Test Suite...


=================================
Executing Pre-Benchmark Tasks
=================================

=================================
LAME MP3 Encoding Benchmark (Run 1 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
LAME MP3 Encoding Benchmark (Run 2 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
LAME MP3 Encoding Benchmark (Run 3 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
LAME MP3 Encoding Results:

Seconds
Seconds
Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Ogg Encoding Benchmark (Run 1 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Ogg Encoding Benchmark (Run 2 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Ogg Encoding Benchmark (Run 3 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Ogg Encoding Results:

Seconds
Seconds
Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
FLAC Audio Encoding Benchmark (Run 1 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
FLAC Audio Encoding Benchmark (Run 2 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
FLAC Audio Encoding Benchmark (Run 3 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
FLAC Audio Encoding Results:

Seconds
Seconds
Seconds

Average: 0.00 Seconds
=================================

=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Timed MPlayer Compilation Benchmark (Run 1 of 1)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Timed MPlayer Compilation Results:

Seconds

Average: 0.00 Seconds
=================================

=================================
Timed PHP Compilation Benchmark (Run 1 of 1)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Timed PHP Compilation Results:

Seconds

Average: 0.00 Seconds
=================================

=================================
ImageMagick Compilation Benchmark (Run 1 of 1)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
ImageMagick Compilation Results:

Seconds

Average: 0.00 Seconds
=================================

=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Nexuiz Results:

Average FPS
Average FPS
Average FPS

Average: 0.00 Average FPS
=================================

[deanjo]

Part 2



=================================
Executing Pre-Benchmark Tasks
=================================

=================================
Time Gzip Compression Benchmark (Run 1 of 5)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Time Gzip Compression Benchmark (Run 2 of 5)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Time Gzip Compression Benchmark (Run 3 of 5)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Time Gzip Compression Benchmark (Run 4 of 5)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Time Gzip Compression Benchmark (Run 5 of 5)
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Executing Post-Benchmark Tasks
=================================
sh: -c: line 0: unexpected EOF while looking for matching `"'
sh: -c: line 1: syntax error: unexpected end of file

=================================
Time Gzip Compression Results:

Seconds
Seconds
Seconds
Seconds
Seconds

Average: 0.00 Seconds
=================================
Results Saved To: test-results/test5.xml
Do you want to view the results in your web browser (Y/n)? N

Would you like to upload these results to PTS Global (Y/n)? N

[Michael]

deanjo: does the latest git commit fix your sh issues?

[deanjo]

No same errors

[Michael]

No same errors

In file phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 154:

Change

"$BENCHMARK_RESULTS = pts_exec("cd " . BENCHMARK_RESOURCE...."


from pts_exec to shell_exec to see if it works then?

[deanjo]

In file phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 154:

Change

"$BENCHMARK_RESULTS = pts_exec("cd " . BENCHMARK_RESOURCE...."


from pts_exec to shell_exec to see if it works then?

Nope, still the same errors

BTW BlueWhite Linux does the same.

[Michael]

Nope, still the same errors

BTW BlueWhite Linux does the same.


Hmmm, wow. Not sure what's going on with that then. It's working fine for me and no other bug reports. All that the commit should have impacted was with hardware detection. And to have it do that for all benchmarks is quite odd.


If you run like phoronix-test-suite benchmark encode-mp3 does it still do it (an individual test as opposed to a suite)?

[laurencevde]

@deanjo + michael:
I ran against the same bug, using gentoo.
(Firstly, I had to install lsb-release, as that wasn't installed by default.)
After some debugging, I found out that os_version() in pts-core/functions/pts-functions_linux.php returned oo" , the last 3 characters of /etc/lsb-release, which contained:
DISTRIB_ID="Gentoo"

So, function parse_lsb_output($desc) is not good enough. Change it to using grep or something, or sourcing that file.

As a workaround, the problem does go away by putting in DISTRIB_RELEASE="2007.0" in /etc/lsb-release.

Oh, and you probably need to clean ~/pts-benchmark-env as it will probably not be complete.

[Michael]

@deanjo + michael:
I ran against the same bug, using gentoo.
(Firstly, I had to install lsb-release, as that wasn't installed by default.)
After some debugging, I found out that os_version() in pts-core/functions/pts-functions_linux.php returned oo" , the last 3 characters of /etc/lsb-release, which contained:
DISTRIB_ID="Gentoo"

So, function parse_lsb_output($desc) is not good enough. Change it to using grep or something, or sourcing that file.

As a workaround, the problem does go away by putting in DISTRIB_RELEASE="2007.0" in /etc/lsb-release.

Oh, and you probably need to clean ~/pts-benchmark-env as it will probably not be complete.


Thanks for that find and testing.

In the latest git code I've modified the parse_lsb_output to remove all quotes from the string, so that should fix it for you.

[laurencevde]

That still is buggy. It might go wrong if there are spaces or other sh-unfriendly characters in the variables in /etc/lsb-release, and it will still return oo if I didn't set DISTRIB_RELEASE. And it will also match (the first) #DISTRIB_REALEASE

The real problem is that in:
$info = substr($info, strpos($info, $desc) + strlen($desc));
strpos($info, $desc) returns 0 if nothing matched.

[Michael]

I've changed it to match the strpos checks being used in the other functions along with stripping spaces... hopefully that then will work in most cases, I hadn't realized that there was much deviation within lsb-release. All in the git repo now.

[polat]

Thanks for the great tool Michael! I've been testing it on my laptop with opensuse 10.3 and run into some issues. It will go through the 3 runs of each bench but die right after the last run. This happens no matter which benchmark or suite I try to run. Here's the output:

sarge:~/phoronix-test-suite> ./phoronix-test-suite run graphics
Would you like to save these benchmark results (Y/n)? Y
Enter a name to save (or merge) these results: firstrun
Enter a unique identifier for distinguishing this series of tests: 02

Phoronix Test Suite will record results!

=================================
Graphics Test Suite
=================================

Running Benchmarks For Graphics Test Suite...


=================================
Nexuiz Benchmark (Run 1 of 3)
=================================
1910 frames 134.2532733 seconds 14.2268412 fps, one-second fps min/avg/max: 8 15 24 (90 seconds)

=================================
Nexuiz Benchmark (Run 2 of 3)
=================================
1910 frames 134.3073017 seconds 14.2211181 fps, one-second fps min/avg/max: 8 15 24 (90 seconds)

=================================
Nexuiz Benchmark (Run 3 of 3)
=================================
1910 frames 134.3740069 seconds 14.2140585 fps, one-second fps min/avg/max: 8 15 24 (90 seconds)
PHP Fatal error: Call to undefined function bcdiv() in /phoronix-test-suite/pts-core/functions/pts-functions-run.php on line 175

[Michael]

You need the bcmath module for PHP installed. Apparently in OpenSuSE it ships separately. It should be php-bcmath or something. Though soon I'll drop the need for bc math.

[polat]

That did it. Thanks for the help!

[deanjo]

Ya Michael, the errors are gone now and mplayer results seem to be a bit more sane now. Just the Nexiuz issue remaining and I created a new thread for that.