It will do no harm to any of your components to invert the phase. The only difference is that the speaker cone will move in the opposite direction as it would with the phase non-inverted (i.e. out instead of in).
However, in your question, you state that the preamp is NON phase-inverting. If this is the case, there is no need to invert the phase unless your source or amp are phase-inverting.
Finally, if you listen primarily to CDs, don't worry too much about it either way. The recording engineers of today have nasty habits of changing the phase from song to song, so you will likely be in the wrong phase 50% of the time.
However, in your question, you state that the preamp is NON phase-inverting. If this is the case, there is no need to invert the phase unless your source or amp are phase-inverting.
Finally, if you listen primarily to CDs, don't worry too much about it either way. The recording engineers of today have nasty habits of changing the phase from song to song, so you will likely be in the wrong phase 50% of the time.