two amps and one pair of speakers

i have two setups, one nad amp for surround sound, and one fisher tube amp for music. is it not advisable two run my one pair of kefs to both amps? of course, i would not be using both amps at once. i saw that niles audio makes a box, the dps-1, which allows you to connect the two amps. but i just hate the idea of not running my speakers directly to the amp. so will running two sets of speaker cables damage the speakers in any way?