I thought my Vandersteen 1Cs were harsh because of my electronics. I replaced almost the entire signal chain, adding a tube preamp, new amp, cables, power cords, etc. Things improved, but I ended up realizing that the speakers were the culprit. Either the metal tweets or the roughness in the crossover range was to blame.
I am now trying Ohm Walsh 2000s. These speakers are a bit different, but in no way harsh on almost any material I throw at them. Very open, dynamic and lively, but only when the source material is as well.