I think most of the mess comes down to 2D, which uses glamor that doesn't work too well, has compatibility issues and isn't feature complete (e.g. no xvideo).