that is X fault. X was broken for Intel graphics. If you want a fast desktop, you need to unbreak X. After doing that, it flies.
Search for
xserver-xorg-backclear.patch
get the sources for xorg-server, patch them, compile them, install them. Very easy with gentoo. If you are using something else - search your distros forums/mailing lists. I am sure somebody has done something about it.