Would a Fabric Room Divider Interfere with sound?

ok, I want to spruce up my HT and the TV with the center channel laying on it and the speakers on the side may be ok to audiophiles, but it is not much to look at from a room aesthetic point of view.

I have a Toshiba 40” projection TV with an Innersound ribbon (not out yet) center channel lying on top of the TV, a pair of Innersound ISIS sitting to either side.
I was thinking about making some kind of cloth partition thingy to sit in front of this with an opening just for the TV monitor to show through. I figured that I could make a simple frame and stretch some cool fabric across to “cover it all up”. My gut tells me “NO! You’ll screw up the sound of those gorgeous ISIS!” (or is it ISISES? anyway...), but I have no scientific point of view to base that on. Is my gut right? Is there anything else that I could do to “bring it all together” that wouldn’t interfere with the sound?
I’m serious, guys, so please help!
-aj