The volume control should also have a source selector on it. the source selector will select what amp you want to connect to. There is some switching hardware that is used for these applications, Check with an AV specialist they can help you get the right equipment for what you are trying to do.
Mark
Mark