Reply With QuoteHmmm very strange! Anyone else experiencing similar issues?
Moderator
Mplayer builds do not complete in suite tests
OK, something really odd here.
Whenever the mplayer compile test is ran from a suite such as
./phoronix-test-suite run universe
or
./phoronix-test-suite run universe-cli
or
./phoronix-test-suite run multicore
I get the mplayer build not completing and giving false results like
If I run just the mplayer compilation test on it's own or in some other suites I get more realistic results.Code:====================================== Timed MPlayer Compilation (Run 1 of 1) ====================================== MPlayer Build Time: 10.51 Seconds ==================================== Timed MPlayer Compilation: Time To Compile 10.51 Seconds Average: 10.51 Seconds ====================================
./phoronix-test-suite run build-mplayer
or
./phoronix-test-suite run compilation
This is with using a clean install of the suite .7 version. All other tests complete fine and give realistic results. It's just mplayer in certain suites.Code:====================================== Timed MPlayer Compilation (Run 1 of 1) ====================================== MPlayer Build Time: 85.05 Seconds ==================================== Timed MPlayer Compilation: 85.05 Seconds Average: 85.05 Seconds ==================================== dean@linux:~/phoronix-test-suite>
Last edited by deanjo; 05-18-2008 at 06:43 AM.
Phoronix
Hmmm very strange! Anyone else experiencing similar issues?
Senior Member
mplayer doesn't work well with make -j (probably a dependency issue). Sometimes it works, sometimes it fails early on with an exit code of 2.
Last edited by apaige; 05-18-2008 at 07:31 AM.
Senior Member
Actually, mplayer seems to fail with make -j on my machine only when I haven't cleared CFLAGS environment variables.
Phoronix
So then are you thinking add CFLAGS = "" into the script?Originally Posted by apaige
Moderator
Same here, oddly enough it only happens in the above suites listed.
./phoronix-test-suite run build-mplayer or ./phoronix-test-suite run compilation or just doing make -j4 never fails.
Phoronix
Can you add CFLAGS="" to your pts/test-resources/build-mplayer/install.sh in the line above the timed make line and see how it runs?
Senior Member
I think the question is larger than that. It's about using optimizations (or not) throughout the test suite. Right now, most benchmarks will pick up users' environmental compiler variables. That's not only compilation benchmarks, but also every benchmark that have apps compile before runnning them (i.e. audio encoding etc...). For that reason, two users with the exact same system can have very different results depending on their environment settings. Ideally, every benchmark would be compiled with specific optimizations for the CPU they run on.
Moderator
Made the changes requested
and then runningCode:sleep 3 CFLAGS="" /usr/bin/time -f \"MPlayer Build Time: %e Seconds\" make -s -j \$NUM_CPU_JOBS 2>&1 | grep Seconds" > time-compile-mplayer
./phoronix-test-suite run universe-cli
still results in this
Still no joy.Code:====================================== Timed MPlayer Compilation (Run 1 of 1) ====================================== MPlayer Build Time: 11.03 Seconds ==================================== Timed MPlayer Compilation: Time To Compile 11.03 Seconds Average: 11.03 Seconds ====================================
Moderator
What does seem to cure the issue is having the mplayer compilation being the first test ran.
Code:dean@linux:~/phoronix-test-suite> ./phoronix-test-suite run universe-cli Would you like to save these benchmark results (Y/n)? y Enter a name to save these results: y Enter a unique identifier for distinguishing this series of tests: attop ==================================== Universe-cli Test Suite ==================================== Running Universe-cli Test Suite... ====================================== Timed MPlayer Compilation (Run 1 of 1) ====================================== MPlayer Build Time: 84.22 Seconds ==================================== Timed MPlayer Compilation: Time To Compile 84.22 Seconds Average: 84.22 Seconds ==================================== ^C dean@linux:~/phoronix-test-suite> ./phoronix-test-suite run universe-cli Would you like to save these benchmark results (Y/n)? y Enter a name to save these results: run2 Enter a unique identifier for distinguishing this series of tests: run2 ==================================== Universe-cli Test Suite ==================================== Running Universe-cli Test Suite... ====================================== Timed MPlayer Compilation (Run 1 of 1) ====================================== MPlayer Build Time: 86.06 Seconds ==================================== Timed MPlayer Compilation: Time To Compile 86.06 Seconds Average: 86.06 Seconds ==================================== ^C dean@linux:~/phoronix-test-suite>
Posting Permissions