You have just discribed what some 'philes may not now, or may not ever, experience. That is a "synergy" within your audio system. If you would like to add another source or would like to correct the details in the sonic field and/or add multiple function, then you need a pre-amp. Since your sound is about dead on, I would suggest a fairly cheap way of addressing the pre-mp issue. The use of a "high quality" Passive pre-amp may suit your needs. I use a McCormack TLC-1 that sells (usually) for under 500.00. It is transparent and detailed my system. There quite a few others, as well, that range from about 500.00 to 2000.00 new (and of course, less used). All of them (that I know of) have had good reviews.
Tubby
Tubby