That's a good point. I suspect we don't all listen for the same thing in music.
For me it's all about the buzz I get from it - the visceral experience of it. I can't put this in words very well - there's a thread here on altered states. It's easier to get from a good hifi system, but sometimes it comes from listening on very modest equipment depending on mood and situation.
I am getting it now from David Lowery's new album on Qobuz. Most often I get from listening to vinyl. However there's no hard and fast rules here.

