I added myself to the video group (on Intrepid with the vanilla xorg.conf) and it hasn't affected the results of glxgears on my machine.