Someone at the Ubuntu forums (click) made an extensive diagram of the X.org... thing. For those of you who don't have a Ubuntu forums account, I've uploaded the diagram here (click).

I found it to be a very helpful resource, as it's very well done and extensive. Can't comment on the accuracy though.