Its reasonable to think you want your system to play with the correct polarity but not all recording are mixed with the correct polarity. So it is hard to know what you are listening too. According to this site 92% of CDs are inverted polarity. I guess you can look at their list and swap your speaker cables for the various albums before you play it. Or you can not worry about it and enjoy the music.
http://audiogeorge.com/the-polarity-list/
http://audiogeorge.com/the-polarity-list/