I think you do what you need to do to maximize the enjoyment of your system. I remember one of my first systems... the result of a real desire for chest compressing bass. My favorite album was the Sheffield Direct to Disk recording of James Newton Howard and Friends Drum Record (1983). It had conclusive bass and highlighted what my system had achieved. I was really drawn to listen to music with drums.
Much later I had gotten into the nuances of electronic music with stuff like the first Enigma album and some really ethereal stuff. I had optimized my system around that. I listened to a lot of that genre... but most classical and jazz sounded terrible.
Anyway, over time I would optimize my system around something and then concentrate on playing that.
Then about twenty years ago I realized that I really needed an empirical ruler so all music would sound great. I listened extensively to natural acoustical music and optimized my system around that. Now, pretty much anything (within reason... horribly recorded or simply terrible music does not work) is simply captivating. I often listen to things it would never dawn on me to like and I am captivated. It took me decades to get my system there.

