I agree with IRstuff, a manual switch will not work and I think there is more to it that just adding pull-up resistors.
Google for "KVM switches"
(Keyboard, Video, Mouse) - these have built-in electronics to fool the computers into believing they still have the 3 devices connected. I used one...