I'm probably coming in too late into this discussion, but it seems to me that one test with 'real-world' utility would be to measure the load (CPU and RAM) imposed on a system playing Flash videos on the YouTube, Hulu, etc. websites (using Adobe's Flash plugin inside a browser, that is).
I'm particularly interested in whether Atom-based netbooks are up to the task... even my 2 GHz dual-core has trouble with this task sometimes. :(
Does such a test exist in the PTS (or could one be added from elsewhere)?
It might be a good idea to have a test of disk performance that is relatively independent of the CPU or other hardware - a sort of cross device standard. For this to work, it would be necessary define a ratio such as (disk performance)/(CPU of System benchmark), which has a value of 100 for a specfic hardware setup.
Whatever happened to this? I really like this idea, and hopefully no one is offended, but it sounds like making a version of PC Mark or Passmark for linux. A nice, quick, overall system benchmark for memory, disk, cpu, graphics, and you get an overall score. Though geekbench kind of does all this doesn't it? And it's included in pts.
I think this is more feasible now, with openbenchmarking providing a geometric means in the analysis section.
(Although there is a bug with the geometric mean, see http://phoronix.com/forums/showthrea...664#post335664 )
I'll try to revive this thread soon :)
So, here goes a dry run:
Here is the idea:
- 2 (CPU + RAM) tests (one with emphasis in single threaded + floating point, one in multi-threaded + floating point)
- 2 GPU tests (one 2D, one 3D)
- 2 disk tests (one READ, one WRITE)
- The CPU seems to be decently covered, and the tests download and run fast.
- I am not happy with the Graphics tests: the 2D failed to install in the second machine I tried, and the 3D is very simple AND takes forever. Any suggestions? We need fast and reliable install, and fast runtime.
- These disk tests seem to focus on throughput, but we really care about random IO for a general speed measure (this is what the OS does more often, by far). My problem so far was finding a test that does that _and_ runs in a couple minutes. Any ideas?
Please test against these if you can and report, as well. Cheers!
Here is one comparison of three systems: an older Vostro V13 with a single core celeron a 1.6 Ghz, a Chromebook with a newer dual core celeron @1Ghz, and an older Phenom 3 core @ 2.5 Ghz.
The numbers make a lot of sense as of the feel for speed of the machines. The V13 makes up in disk speed (SSD) against the Chromebook (with a regular HD) with more CPU and GPU power. The Phenom is outdated but overall faster, paired with a modest (but faster than a Celeron IGP) Radeon HD 4650, and an SSD.
The scores for the three are 1, 1.13 and 1.71, respectively.
I like the idea, but we need better ideas for some of the tests, as discussed above.
Mmm ... I am thinking that including graphics might not be great, in that a server may only be CLI. Here is a test with three legs: sinlge thread, multithreaded, disk. The overall scores at the end seem pretty intuitive to me from using all these systems:
It might be better to have twp suites: QUICKBENCH-CLI and a QUICKBENCH-GUI.
Im looking for a good graphics test that will install on linux. I like the quicktest v4 but not the v5 that test does not always install on every machine
And the test installed for qgears2 doesn't seem to be aware of that. It is hard to find a simple test that will at least assess very crudely how 'fast' the IGP is, that also runs fast, and that doesn't involve a huge download. Sigh!
Anyways, many thanks for chiming in!