This is highly speaker dependent - well designed speakers (that do not beam like a flashlight at certain frequencies but flood the room evenly with all frequencies) will not really give two hoots for toe-in (except if the speaker is too close to a side wall).
The fact that toe-in has a huge impact for many speakers speaks volumes about the way they unevenly light up the room (to continue with the flashlight analogy).
