Off when not in use. Ask you amp's designer if it sounds different, in their experience, after it has been on a while. My designer said turn it off, but not tell anyone, if I wanted to stay in the "club." I do not appreciate in difference in sound, either.
Charlie
Charlie