thanks. VNC is actually a more suitable solution for me but just that the multiple xserver(which is what xvncserver does) on the server scares me a bit in terms of resource. Didn't test it though.

However, it seems that VNC is slower than X, at least in my limited test situation on a local 100Mbps network, especially when I hold the scrollbar and drag. This is understandable as VNC need to sort of redraw the screen in a pixel by pixel for each small movement. The difference is though quite noticeable.