There's no way of disabling that feature, you'll have to get use to holding your hand over the the front of the remote when changing devices.