many (most?) loudspeakers have their two or three drivers wired in opposing polaritieshopefully to correct crossovers phase shift and not arbitrarily.
It is more than the bass that is affected. Percussion has very steep transients, sometimes exceeding 20KHz on tape and LP. On quality phase coherent systems, the effect is clearly audible by some. Not all are sensitive to it.
Expanding on what Al said regarding polarity flip circuits, even in fully balance circuitry, they are seldom in themselves inaudible. This can be demonstrated by reversing loudspeaker polarity and listening to the A:B, which is quite likely C:D.