This was just intended to be a very quick comparison, take it for what you want. The proprietary Catalyst driver would have been used if a public X Server 1.7 supporting release was available.
As some people said, this is a useless comparison. I'm all for comparing closed vs open drivers for the same chip, but comparing open vs closed drivers when its pretty much known what the results would be is really pointless.
I was actually interested in seeing the performance difference between the chips. My conclusion after this review: err, none at all...
You might as well just used nouveau and concluded that using open-source ati is faster than using mesa software rendering.
I too am very disappointed with this comparison.
Seems I'm the only one that thought this was ok.
Everybody says this was common knowledge. Well not for me.
I mean I knew that foss drivers are not as fast as closed source drivers. But in this case the foss driver had as advantage a better hw. Still this was not enough.
So for me this test was not useless.
On the other hand, I also think that it would be nice to also have nouveau and fglrx in the tests.
Nothing is angeled to make anyone look bad, besides making it difficult to test fglrx with the lack of an X Server 1.7 supported release that should be out by now. This was simply running a few tests with the available hardware at hand before the systems were thrown into the farm for the Ubuntu Tracker.
I would to point out that it was made quite clear in the article that it was closed source vs open source, and that things were as expected.
With that said, I don't see why a supported version of Ubuntu couldn't have been used - AMD have a history of not supporting "beta" distros; so for them, xserver 1.7 support isn't a priority until their supported distros have it in stable.