We're starting from scratch and we can't do better than copying framebuffers through a fancy lossy encoder and send it over the wire. Will there ever be something that works as nice as (dare I say) Microsoft's RDP for remote GUI under Unix/Linux?
I mean we could do pretty efficient things if we'd send Qt and GTK+ representations instead of bitmaps.