What is it that you switch? A rotary pot, a toggle, or pushbutton?
Is it only with the phono? What happens when you switch from phono to a different input? Or from one non-phono to a different non-phono input?
Narrowing down the instances where and when the hum happens and when it doesn't happen will be very helpful in directing your troubleshooting efforts.