I agree with Newbee. If it sounds OK outside the listening position, you're probably getting too many reflections at the listening position. It might help if you described your set-up: size of room, locations of speakers, location of listening position, absorptive materials. Even toeing in the speakers or keeping them pointed straight ahead could make a differenc.
Generally, things sound best with the speakers inside the room and good absorption at the first reflection points (i.e., next to the speakers on the walls, in front of the speakers on the floor) and good absorption both behind the speakers and behind the listener. Too much is just as bad as not enough (nobody wants a dead sounding room), so start light and build it up. First reflection points are the most critical so start there.