Not really, assuming you have a decent SS amplifier and reasonable speakers, the crossover and EQ won't interact very much, but your point that EQ should be used sparingly is not wrong.
Using EQ well is an art. In the bass, you want surgical precision. In the midrange and treble you want to be delicate.
You can only adjust a speaker so far, and the idea of using an EQ to make up for it's deficiencies never works out well. What EQ does well is in the mastering process, or to help correct for certain room problems.
Also, using them as tone controls, with grouped, and gentle adjustment is a good thing.
Best,
E