Sounds like a driver bug. If it still happens with the latest kernel, libdrm and mesa, it would be useful to file a bug.
I posted this issue on the Mint forums but got no reply. So I apologize for cross posting.
This was observed on Tux Racer (or whatever name it goes by), running on the new Mint Debian edition (which is basically Debian Squeeze).
Hardware is T30 Thinkpad, Radeon 7500, screen resolution is 1024x768.
When I start Tux Racer, everything looks fine, music plays, menu works. However, when I initiate a race, it crashes, blank screen for a moment, and suddenly my system is now set to 800x600.
If I run in a terminal, I see this:
%%% etracer warning: Attempt to bind to Texture unloaded texture: `b-herring_run_icon'
drmRadeonCmdBuffer: -12. Kernel failed to parse or rejected command stream. See dmesg for more info.
Checking dmesg doesn't tell me anything:
[ 193.838254] [drm:radeon_cs_ioctl] *ERROR* Failed to parse relocation -12!
I'd like to learn about what's happening, and if there's a fix.
John
Sounds like a driver bug. If it still happens with the latest kernel, libdrm and mesa, it would be useful to file a bug.
The mode change is due to the 3D app changing the mode and then exiting without changing it back due to the command stream getting rejected by the kernel. You can use xrandr to change the mode back. I'd try a newer mesa or kernel and see if that helps.
It's pretty easy if it's debian based: http://liquorix.net/
You don't need clonezilla, when you install a new kernel from liquorix you will still be able to choose your old kernel from grub.