Many tests fail: empty result w/ PTS v1.8.1, 2.0.0 & 2.2.0a1

[kozaki]

Hey, really do appreciate PTS features and web site, especially when advising someone about this or that hardware/tech

Now I've got serious issue with PTS on a Mandriva 2009.1 x86_64.
Can get no results with most of the tests/suites I've tried lately, with PTS v1.8.1 (rpm), v2.0 (rpm and source) as well as v2.2.0a1 (git ):

There are 3 different cases:

1) 7zip runs fine, as well as 1080videoHD and superPI.

2) no result at all. Console's empty with "Average: 0.00" at the end. THe case with lame mp3, FFMpeg, mencoder

3) Test runs fine (prints timing for each pass) but no result's visible, like with Gzip, Ogg Vorbis, Monkey & FLAC

Any help welcome.

Have launched PTS with the 'benchmark' option, and installed any required dependacies each test required.

Have moved ~/.phoronix-test-suite and let it be re-created at 1st PTS restart, re-downloading all the necessary files

Issue being the same with packaged/source, system wide/user, PTS 1.8.1, 2.0.0 and 2.2.0a1, might be OS related. Like a missing dependency. If that's the case, IMHO PTS doesn't help a lot finding what's missing.

Here are some possibly related issues I've followed without succes so far:

• mrlinux with PTS 2.0.0 on Timed Apache Compilation
• darthanubis with PTS 1.8.1 on SQLite tests. Solved after installed glibc-2.10.1-2.i686
• Nando test-ressource on FPS with Mplayer
• Archlinux users back in 2008-05 got it working after editing php.ini file to enable posix commands
• deanjo with PTS 0.1...

Examples of the 2 cases I have (results on each passes without global result, and no result printed at all):

$ ./phoronix-test-suite benchmark compress-gzip
...

Running Pre-Test Scripts...
1048576+0 records in
1048576+0 records out
2147483648 bytes (2,1 GB) copied, 29,9072 s, 71,8 MB/s

====================================
Gzip Compression (Run 1 of 3)

...

Gzip Compression (Run 3 of 3)
====================================
                                   
Test-Time: 51,651048898697 Seconds

####################################
Gzip Compression:
2GB File Compression

Average: 0.00 Seconds
####################################

$ ./phoronix-test-suite benchmark mencoder
...

====================================
Estimated Run-Time: 3 Minutes
====================================


====================================
Mencoder (Run 1 of 3)

...

Mencoder (Run 3 of 3)
====================================


####################################
Mencoder:
AVI To LAVC

Average: 0.00 Seconds
####################################

~ ./phoronix-test-suite diagnostics (local/user)

====================================
Phoronix Test Suite v2.2.0a1 (BARDU)
Diagnostics Dump
====================================

PTS_PATH = /home/me/Telechargement/src/phoronix-test-suite/
PTS_MODE = CLIENT
PTS_LIBRARY_PATH = /home/me/Telechargement/src/phoronix-test-suite/pts-core/library/
PTS_VERSION = 2.2.0a1
PTS_CODENAME = BARDU
PTS_MODULE_UNLOAD = PTS_MODULE_UNLOAD
PTS_QUIT = PTS_QUIT
PTS_CORE_PATH = /home/me/Telechargement/src/phoronix-test-suite/pts-core/
PTS_USER_DIR = /home/me/.phoronix-test-suite/
PTS_CORE_STORAGE = /home/me/.phoronix-test-suite/core.pt2so
XML_DISTRO_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/distro-xml/
SCRIPT_DISTRO_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/distro-scripts/
ETC_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/etc/
MODULE_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts-core/modules/
MODULE_LOCAL_DIR = /home/me/.phoronix-test-suite/modules/
RESULTS_VIEWER_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts-core/results-viewer/
TEST_LIBRARIES_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts-core/test-libraries/
STATIC_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts-core/static/
OPTIONS_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts-core/options/
XML_PROFILE_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/test-profiles/
XML_PROFILE_CTP_BASE_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/base-test-profiles/
XML_SUITE_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/test-suites/
TEST_RESOURCE_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/test-resources/
TEST_RESOURCE_CTP_BASE_DIR = /home/me/Telechargement/src/phoronix-test-suite/pts/base-test-resources/
XML_PROFILE_LOCAL_DIR = /home/me/.phoronix-test-suite/test-profiles/
XML_SUITE_LOCAL_DIR = /home/me/.phoronix-test-suite/test-suites/
TEST_RESOURCE_LOCAL_DIR = /home/me/.phoronix-test-suite/test-resources/
PHP_BIN = php
PTS_INIT_TIME = 1253722723
PHODEVI_AVOID_CACHE = 0
PHODEVI_STAND_CACHE = 1
PHODEVI_SMART_CACHE = 2
OPERATING_SYSTEM = Linux
OS_PREFIX = linux_
PTS_GSID = XZGIVM428
TEST_ENV_DIR = /home/me/.phoronix-test-suite/installed-tests/
SAVE_RESULTS_DIR = /home/me/.phoronix-test-suite/test-results/
PTS_USER_LOCK = /home/me/.phoronix-test-suite/run_lock
PTS_STARTUP_TASK_PERFORMED = 1

End-User Run-Time Variables:
VIDEO_RESOLUTION = Unknown
VIDEO_CARD = GeForce 6200 TurboCache 256MB (350/550MHz)
VIDEO_DRIVER =
OPERATING_SYSTEM = MandrivaLinux 2009.1
PROCESSOR = AMD Athlon 64 3200+ @ 2.48GHz (Total Cores: 1)
MOTHERBOARD = 939Dual-SATA2
CHIPSET = ALi M1695 K8 Northbridge
KERNEL_VERSION = 2.6.29.6-desktop-2mnb
COMPILER = GCC 4.3.2
HOSTNAME = llewellyn

Environmental Variables (accessible via test scripts):
PTS_VERSION = 2.2.0a1
PTS_CODENAME = BARDU
PTS_DIR = /home/me/Telechargement/src/phoronix-test-suite/
PHP_BIN = php
NUM_CPU_CORES = 1
NUM_CPU_JOBS = 2
SYS_MEMORY = 1002
VIDEO_MEMORY = 256
VIDEO_WIDTH = -1
VIDEO_HEIGHT = -1
VIDEO_MONITOR_COUNT = 1
VIDEO_MONITOR_LAYOUT = CENTER
VIDEO_MONITOR_SIZES = Unknown
OPERATING_SYSTEM = mandrivalinux
OS_VERSION = 2009.1
OS_ARCH = x86_64
OS_TYPE = Linux
THIS_RUN_TIME = 1253722723
DEBUG_REAL_HOME = /home/me/

[Michael]

In regards to the first problem, it's showing the time with the decimal point being delimited by a comma rather than a period, likely due to your locale settings. Though PTS should be overriding that... I can try using number_format() to possibly work around that, but I haven't heard of any of those issues in a while.

I think your two other problems might also be related to that as well.

[kozaki]

Hey Michael,
Ok thanks for your input.
locale variables are all on 'fr_FR.UTF-8' (but 'LC_ALL'), as they probably are on most of French speaking people's desktop systems (must be equivalent for Canadian French, Belgium, etc):
$ locale

LANG=fr_FR.UTF-8
LC_CTYPE=fr_FR.UTF-8
LC_NUMERIC=fr_FR.UTF-8
LC_TIME=fr_FR.UTF-8
LC_COLLATE=fr_FR.UTF-8
LC_MONETARY=fr_FR.UTF-8
LC_MESSAGES=fr_FR.UTF-8
LC_PAPER=fr_FR.UTF-8
LC_NAME=fr_FR.UTF-8
LC_ADDRESS=fr_FR.UTF-8
LC_TELEPHONE=fr_FR.UTF-8
LC_MEASUREMENT=fr_FR.UTF-8
LC_IDENTIFICATION=fr_FR.UTF-8
LC_ALL=

What can i do?
Never encountered this issue since 2008 til April 2009 (following PTS version, and date when i upgraded my desktop system with Mandriva 2009.1)
Should i temporarily assign "en_US" to the LC_NUMERIC variable before running PTS? If so, should I also recompile the binaries (mplayer, mencoder etc)?

[Michael]

Can you temporarily override LC_NUMERIC? In PTS we override most of the LC_* env variables, but LC_NUMERIC might be missing. Try that one and then just re-run the test, you shouldn't need to rebuild. If that fixes it, I will override that one too in pts-core.

[Michael]

Can you temporarily override LC_NUMERIC? In PTS we override most of the LC_* env variables, but LC_NUMERIC might be missing. Try that one and then just re-run the test, you shouldn't need to rebuild. If that fixes it, I will override that one too in pts-core.

and if the problem persists, try some of the other LC_ variables

[morgoth]

Can you temporarily override LC_NUMERIC? In PTS we override most of the LC_* env variables, but LC_NUMERIC might be missing. Try that one and then just re-run the test, you shouldn't need to rebuild. If that fixes it, I will override that one too in pts-core.

Hi Michael,

I'm also running a French Mandriva and I had the same issue with iozone test (result was Average: 0.00 MB/s).

I tried to override LC_NUMERIC:
$ export LC_NUMERIC=en_US.UTF-8
$ phoronix-test-suite benchmark iozone
and now it works fine.

Please fix the decimal issue as it will certainly hit many non EN/US people.

Thanks

Julien

[Michael]

Thanks, will add in LC_NUMERIC in there too.

[kozaki]

@morgoth: Many thanks for your input! was too busy to go any further.
@Michael: thank you for implementing LC_NUMERIC in a future PTS release as an internationalization effort for non English users