Two amplifiers feeding the same pair of speakers?

I have a situation where it would be great if I could feed the same pair of speakers from two different sources. Will this work as long as I was always careful to only have one source sending signals at a time? If so, is there any special way I need to configure this or would it be as simple as having two sets of speaker cables going to each speaker?

Thanks!