Desktop/Whiteboards/PerUserXServer

Doing this basically requires putting the X server on top of a small display server. Kristian has ideas (and even some code) for this, see Desktop/Whiteboards/Wayland.