Due to apartment life, my TV resides between my speakers and it does mess with the sound. Try throwing a wool blanket over the TV and you'll hear for yourself how much better your system will sound.
Not all of us can eliminate the TV but, for me, mounting the TV on the wall moved it back enough to have a sizable improvement on the sound. I wouldn't fret over it if I were you.
All the best,
Nonoise