It sounds to me like your amp is running out of gas. If your average is 90dB, your amp is probably clipping on peaks, assuming your speakers are roughly 87dB sensitivity. 100W would give you a peak loudness of 107dB, i.e. 17dB of headroom, which could clip on peaks. This is not bad performance, you're just pushing the limits of what your gear can do.
