Speaker selector that won't degrade sound

Is there such a thing?

Seems like many of them have relays or protection devices in them that will affect sound quality.  Could I make one?  

The reason for one is that my system is now a hybrid, my 2 channel setup and HT setup use the same front speakers.  Have an Onkyo AVR with no pre-outs and a Schiit Freya+ as my 2 channel preamp, so no way of doing a HT bypass so I want to use a speaker selector and have both feed into the selector.  Right now I literally swap the speaker cables at the back of the speaker.