To my surprise it's really not that bad without the center channel in place.
Unless you have a center that matches your mains exactly and is placed at the same height then then phantom center is probably slightly better for a small sweetspot area. Center is really only needed for off axis listeners.