Do I NEVER shut it off…?

I believe that if you have a well regulated power supply, an amp can be turned off.  As Paul of PS Audio says, the huge turn on current of amps can eventually damage them.  My Audire's have 4 26.000 mf filter caps per channel to fill, but with one chip per channel to regulate the current, it has so far not been an issue for 40 years. I wonder why PS Audio doesn't use this, or if they do, why would there be a lot of current?   I do know:  An audio manufacturer can use fewer, smaller filter caps to save money, but then they must recharge immediately.  The Audire's 200 wpc Bryston contemporary used two 4000's per channel, vs. my 125 wpc Audire's 4 26,000 per channel.  At a medium volume, it plays for about 20 seconds after turnoff.  Three of theses does not blow a 15 amp breaker at turn on, so my 30 amper is fine.

Leaving the amp on at all times puts the anal in analogue.Oh, I was going to save that for the turntable crowd.

Anal audiophile? Redundant. Anal analogue audiophile? Double redundant.... 

I believe that if you have a well regulated power supply, an amp can be turned off.

A well regulated power supply, being necessary to quality of a high end system, the right of the people to leave it on shall not be infringed.

regulated power supply, an amp can be turned off. 

I think you mean a soft start circuit, not a regulated power supply two very different circuits that do two very different things.