Benchmarks on a rolling release such as Arch/gentoo would show more what unpatched linux does. The problem with ubuntu is the patching of patches which end up with for example Intel gfx issues.
But phoronix is doing a great job, and I'm sure using ubuntu gets a lot of readers in.
It would be nice to have a script that runs the benchmark for us and we can view the results for ourselves. I can't imagine that that would be "illegal", or even a "contractual violation"
I wonder if there is any way to procure a copy of VMware Player without agreeing to the EULA. In this case one could publish benchmarks, because one did not enter into any sort of contract.
Last edited by frantaylor; 08-05-2009 at 08:52 AM.
And what is wrong with showing what unpatched linux does ? And btw, Gentoo too can be easily patched.Benchmarks on a rolling release such as Arch/gentoo would show more what unpatched linux does. The problem with ubuntu is the patching of patches which end up with for example Intel gfx issues.
It's not "illegal", it's a "contract violation" to publish benchmark results for many products. Read the EULA. Oracle is another example of this.
EMC would probably work their legal wiles and take down any web site that published VMware benchmark results. However, there is nothing wrong with publishing the benchmark program itself. The curious can run the benchmark themselves, and use the results for decision-making, as long as they don't publish the results.
The problem with benchmarks of big complex software is that the results are often dependent on hardware or software setup or whatever, and the results are not very useful unless you just happen to have exactly the same setup.
See here why:
Look at the March 12th at the bottom of the page.
You may use the Software to conduct internal performance testing and benchmarking studies, the results of which you (and not unauthorized third parties) may publish or publicly disseminate; provided that VMware has reviewed and approved of the methodology, assumptions and other parameters of the study. Please contact VMware at email@example.com to request such review.
Last edited by deanjo; 08-11-2009 at 11:16 AM.
Basically all VMs have got problems with timers. If you really want to benchmark then use a manual stop watch. Timers tend to run pretty much like the moon inside VMs
The guests' real time clock in Vmware Workstation 6.5.2 is really quite accurate. It uses the timer in the host system. The clocks in my VMs stay accurate to within a second over days of use despite heavy loading of both the guest and host operating systems.