Ubuntu 7.04 to 8.10 Benchmarks: Is Ubuntu Getting Slower?
Phoronix: Ubuntu 7.04 to 8.10 Benchmarks: Is Ubuntu Getting Slower?
With the release of Ubuntu 8.10 coming out later this week we decided to use this opportunity to explore how the performance of this desktop Linux operating system has evolved over the past few releases. We performed clean installations of Ubuntu 7.04, Ubuntu 7.10, Ubuntu 8.04, and Ubuntu 8.10 on a Lenovo ThinkPad T60 notebook and used the Phoronix Test Suite to run 35 tests on each release that covered nine different areas of the system. After spending well more than 100 hours running these tests, the results are now available and our findings may very well surprise you.
Do you plan to extend that benchmark-testing to other hardware-setups and/or other distributions?
Best regards ...
Yeah there's plans to at least run the same set of tests on Fedora on the T60. Possibly other distros too depending upon time and what the results are from Fedora. Other hardware setups too are planned. Ideally the Fedora results would be out by week's end.
I believe that canonical have a large set of machines that run automated tests of development releases. Maybe you could talk them into including performance tests.
The sooner the regressions are spotted, the easier to find which change caused them. The dramatic change in RAM speed must surely be some kernel bug.
Have you tried 64 bit tests? A lot of the optimisation in GCC is not enabled in 32bit ubuntu to keep compatibility with i586.
Cool work on these tests.
It looks like these might be kernel regressions. You can try the kernels from the older distros on the newer ones to check if that's the case.
Also, trying out the 64-bit distros helps. As ssam noted, the kernels and packages are not compiled with several optimizations enabled. Also, most of the newer distros will be installed on newer hardware, which means it's 64-bit capable. There's really no reason to run 32-bit distros these days.
Phoroix should also do a similar tests on some server(http, db, file etc) versions (both between releases and distros if possible). There will be lot of interest regarding this aspect.
And ofcourse, great work. These are the reviews which we actually need.
that is no problem of canonical...it's a problem that affects the kernels...since 2.24 the kernels are getting slower and slower...I've heared that from sidux users, from fedora users and from Debian users...they are all saying the same: since 2.24 they are loosing frames in first-person-shooter like ET:QW and UT2k4
so, maybe someone should talk to the kernel hackers and say them, that a sleep function after each function is NOT necessary...
It might be possible to locate these regressions by running a newer backported kernel on ubuntu 7.04 (or possibly run the older 2.6.20 kernel with 8.10).
This could isolate the issue to the kernel, or otherwise to another component, such as GCC. From there, it should be possible to further bisect the kernel to find the source of these performance regressions.
Keep up the excellent work!
Eh, it didn't look like such a huge loss to me overall :-/
The cause for the bad performance is the CFS (Completly Fair Scheduler), I think. It's standard since 2.6.23/24.
World of Warcraft on Wine lags terrible and freezes every some seconds since the introducing of CFS.
I hope OpenSolaris supports my hardware completly soon, so that I can change to this OS.