Is it good to upgrade the crossovers in your speakers?

A confessed audiophile, threw this Forum I have contracted “Tweakitus”.
QSA fuses, SRA Platforms, Townshend Podiums, NPS Q45T, ad nauseam.

The latest bug in my bonnet is upgrading the crossovers in my speakers.

I asked my speaker designer about part quality. He did mention that caps, for example, can cost as much as $800 each. And that he has gone up to $50 ones.

Like all things “Hi Fi”, cost does not necessarily dictate quality. And I doubt that I would opt for 2 $800 caps. But there must be a sweet spot for crossover components? Any ideas?