Volume considerations

I agree that much of this has to do with the room. A well treated room will allow more volume without sacrificing fidelity.

Sometimes I listen at a high volume level, but try to keep it at 85 db or less.  I have some hearing loss and don't want to make it worse.  My spouse is not a music enthusiast as I am and therefore doesn't like "loud" music.  My system is in my basement so it is somewhat isolated from the upper living space, so if I listen at 60-70 db it is not distracting (at least not too much!).  I do find myself adjusting the volume to the recording or album, as the mixing is different for each source.  Also, the quality of the recording deeply affects the volume you listen at.  I am amazed that many older recordings have a much better studio quality than much of the later music available today.

The more resolving the system the lower the loudness required lest you want to savour the full glory of peaks.