Page 4 of 5 FirstFirst ... 2345 LastLast
Results 31 to 40 of 49

Thread: Why does Phoronix use Ubuntu for Benchmarking ?

  1. #31
    Join Date
    Mar 2009
    Location
    Hellas
    Posts
    1,113

    Default

    Quote Originally Posted by frantaylor View Post
    The desktop is more than fast enough for me already. I don't care if a text box draws 1.4% faster on one distribution than another.
    But benchmarks have rarely practical use. Their existence is only to prove that my distro/OS is better than yours for no real reason

  2. #32
    Join Date
    Jul 2009
    Posts
    351

    Default

    Quote Originally Posted by Apopas View Post
    But benchmarks have rarely practical use. Their existence is only to prove that my distro/OS is better than yours for no real reason
    Well that is just bogus because there are many issues. Some ethernet cards just suck and you cannot see for sure unless you benchmark. If you tweak on the block size for your disk partitions it will have impact, but you will not know unless you benchmark. Often there are multiple ways to write an algorithm and you cannot tell which is faster unless you benchmark. There is a bewildering array of optimizations for gcc and you cannot tell which will make your program run faster unless you benchmark.

  3. #33
    Join Date
    Oct 2007
    Location
    UK
    Posts
    160

    Default

    Quote Originally Posted by frantaylor View Post
    Centos 5 in VMware versus Centos 5 in qemu, for example.
    Releasing Vmware benchmarks is illegal. sorry ;-)

    Benchmarks on a rolling release such as Arch/gentoo would show more what unpatched linux does. The problem with ubuntu is the patching of patches which end up with for example Intel gfx issues.

    But phoronix is doing a great job, and I'm sure using ubuntu gets a lot of readers in.

  4. #34
    Join Date
    Mar 2009
    Location
    Hellas
    Posts
    1,113

    Default

    Quote Originally Posted by frantaylor View Post
    Well that is just bogus because there are many issues. Some ethernet cards just suck and you cannot see for sure unless you benchmark. If you tweak on the block size for your disk partitions it will have impact, but you will not know unless you benchmark. Often there are multiple ways to write an algorithm and you cannot tell which is faster unless you benchmark. There is a bewildering array of optimizations for gcc and you cannot tell which will make your program run faster unless you benchmark.
    If I didn't like benchmarks I wouldn't be here and their usefulness is obvious. I had in mind some desktop benchmarks like lame encoding which mainly differs by 1-2% between the dists when I made the post.

  5. #35
    Join Date
    Jul 2009
    Posts
    351

    Default

    Quote Originally Posted by lordmozilla View Post
    Releasing Vmware benchmarks is illegal. sorry ;-)

    Benchmarks on a rolling release such as Arch/gentoo would show more what unpatched linux does. The problem with ubuntu is the patching of patches which end up with for example Intel gfx issues.

    But phoronix is doing a great job, and I'm sure using ubuntu gets a lot of readers in.
    Is it publishing the benchmark that is "illegal", or is the publishing of the RESULTS of the benchmark that is "a contractual violation"?

    It would be nice to have a script that runs the benchmark for us and we can view the results for ourselves. I can't imagine that that would be "illegal", or even a "contractual violation"

    I wonder if there is any way to procure a copy of VMware Player without agreeing to the EULA. In this case one could publish benchmarks, because one did not enter into any sort of contract.
    Last edited by frantaylor; 08-05-2009 at 09:52 AM.

  6. #36
    Join Date
    Jul 2008
    Location
    Bangalore, India
    Posts
    102

    Default

    Quote Originally Posted by lordmozilla View Post
    Releasing Vmware benchmarks is illegal. sorry ;-)
    Releasing VMWare benchmarks is illegal ? Since when ? How ? Why ?

    Benchmarks on a rolling release such as Arch/gentoo would show more what unpatched linux does. The problem with ubuntu is the patching of patches which end up with for example Intel gfx issues.
    And what is wrong with showing what unpatched linux does ? And btw, Gentoo too can be easily patched.

  7. #37
    Join Date
    Jul 2009
    Posts
    351

    Default

    Quote Originally Posted by MetalheadGautham View Post
    Releasing VMWare benchmarks is illegal ? Since when ? How ? Why ?


    It's not "illegal", it's a "contract violation" to publish benchmark results for many products. Read the EULA. Oracle is another example of this.

    EMC would probably work their legal wiles and take down any web site that published VMware benchmark results. However, there is nothing wrong with publishing the benchmark program itself. The curious can run the benchmark themselves, and use the results for decision-making, as long as they don't publish the results.

    The problem with benchmarks of big complex software is that the results are often dependent on hardware or software setup or whatever, and the results are not very useful unless you just happen to have exactly the same setup.

  8. #38
    Join Date
    May 2007
    Location
    Third Rock from the Sun
    Posts
    6,587

    Default

    Quote Originally Posted by MetalheadGautham View Post
    Releasing VMWare benchmarks is illegal ? Since when ? How ? Why ?
    It's been in the EULA for as long as I remember.

    See here why:

    http://blogs.vmware.com/virtualreali.../03/index.html

    Look at the March 12th at the bottom of the page.

    You may use the Software to conduct internal performance testing and benchmarking studies, the results of which you (and not unauthorized third parties) may publish or publicly disseminate; provided that VMware has reviewed and approved of the methodology, assumptions and other parameters of the study. Please contact VMware at benchmark@vmware.com to request such review.
    Last edited by deanjo; 08-11-2009 at 12:16 PM.

  9. #39
    Join Date
    Aug 2007
    Posts
    6,646

    Default

    Basically all VMs have got problems with timers. If you really want to benchmark then use a manual stop watch. Timers tend to run pretty much like the moon inside VMs

  10. #40
    Join Date
    Jul 2009
    Posts
    351

    Default

    Quote Originally Posted by Kano View Post
    Basically all VMs have got problems with timers. If you really want to benchmark then use a manual stop watch. Timers tend to run pretty much like the moon inside VMs
    There is nothing wrong with the timer on the bare metal machine in which the VMs are running. Processes inside of VMs can easily communicate with the host system, and vice versa.

    The guests' real time clock in Vmware Workstation 6.5.2 is really quite accurate. It uses the timer in the host system. The clocks in my VMs stay accurate to within a second over days of use despite heavy loading of both the guest and host operating systems.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •