You’ve already got the Mac Mini, you should at least give it a try as a test. Mac Mini can sound pretty good in my experience! Especially the newer ones with the M series processors.
I’m fairly sure you can’t connect HDMI in this case. Same physical connector but different format so it won’t work for music. I’d start with USB and spend some time listening. Use that as a baseline to grow from as you potentially upgrade some things. Maybe then try adding something like an iFi iPurifier3 which is an inline USB filter, I know people who use those with great results (and they are fairly cheap).
You could add a USB to HDMI converter like the Matrix, or one of the ones from Denafrips for a matching look. That may improve sound quality. Even so, I would spend time on regular USB first before adding an upgrade of that sort. That way you can better judge if it is helps or is worth the money.

