I am attempting to use PTS 3.0.0 to benchmark a new server I got at work. This is a Dell R910 with 32 cores (64 with SMT which I have disabled for these tests), and 256GB of DDR3. I am running the universe-cli suite, as I do not intend to install a GUI on the system. I have run into several tests failing to run, and thought it might be good to report the errors here so that they may be fixed in a future version of PTS.
First off, two tests which fail with >8CPUs, mencoder & ffmpeg. Neither of these tests like it when you tell them to use more than 8 threads. As I mentioned above, the system I'm testing happens to have 32 cores, so using $NUM_CPU_CORES causes the tests to fail.
Next, compress-pbzip2 which as far as I can tell seems to work when I run the command line by hand, but tells me "The test did not produce a result" each time it runs. I think this is a timing issue (as in, the test isn't timed correctly, or assumes that the result will be greater than specific value and is throwing away the results because they're too fast?).
I also had an issue with a couple of Compile Bench tests, Compile and Read Compiled Tree, though the Initial Create test worked fine. I think this is a parsing error, as the results I get from running the test in debug mode seem to indicate that both the compile & the read tree worked correctly:
Next is mrbayes, which is another case of too many CPUs:
intial create total runs 10 avg 146.98 MB/s (user 0.59s sys 0.91s)
no runs for create
no runs for patch
compile total runs 10 avg 792.47 MB/s (user 0.12s sys 0.74s)
no runs for clean
no runs for read tree
read compiled tree total runs 3 avg 826.78 MB/s (user 0.38s sys 0.71s)
no runs for delete tree
delete compiled tree total runs 10 avg 0.95 seconds (user 0.25s sys 0.69s)
no runs for stat tree
no runs for stat compiled tree
Finally, java-scimark2 FFT test failed as well. This appears to be another parsing error, as the test definitely produces results:
The number of chains must be at least as great
as the number of processors (32)
I hope that these reports are useful, and if any further information is required I will be happy to provide it.
Java SciMark (Run 4 of 4)
Test Run Command: cd /home/thalin/.phoronix-test-suite/installed-tests/pts/java-scimark2-1.1.1/ && ./java-scimark2 TEST_FFT 2>&1
Composite Score: 865.7334474774465
FFT (1024): 538.1797821272396
SOR (100x100): 963.7184161416388
Monte Carlo : 459.6497601801464
Sparse matmult (N=1000, nz=5000): 867.1650672662963
LU (100x100): 1499.954211671911
java.vendor: Sun Microsystems Inc.
Result Parsing Search Key:
Result Line: Composite Score: 865.7334474774465
Test Result Value:
The test did not produce a result.