There are digital front end tweeks that make a big difference in my systems.
First, a high quality audiophile switch in the chain before your server. You can keep your existing switch and send one feed to a nice switch like the Network Acoustics Tempus, GTT DeJitterit, or JCAT M12. Then feed your audio. Use good LAN cables between your switch and audio equipment. Finally, as @knock1 says, an ethernet filter. I like the Network Acoustics Muon Pro, These upgrades, at this level, are good to stay with whatever streamer or DAC you choose down the road.
Start with one of them...you should easily hear it.

