This might be really difficult. It implies that the active vessel isn't the one in which you're sitting.
First: how do you activate this mode? Maybe a selector page on an MFD?
So when you select the nearby vessel to control, it would have to switch to that vessel but maintain the current IVA.