I don't think that you can do this without noticing some degradation to avail bandwidth. If I were going to try to do this, I would try Tight VNC which is optimized for low bandwidth usage.

http://www.tightvnc.com/download.html