Interesting that you are currently using your phone but indicate it causes "high pitched change" to the sound quality. But then you say you don't want to use a DAP because it looks too much like a phone.
One other thought -- you could try a Raspberry Pi with the Raspberry Pi or pCP OS and enable the LMS (server) program. This would allow you to plug in external storage devices (USB A inputs) which could be managed with a browser program on your PC, laptop, tablet or phone. You'd still need an adaptor for SD cards. And you'd probably also need a bluetooth dongle for that feature. You'd need to do some research to make sure it does everything you want and then more setup work than for a preconfigured device, but you could customize it as much as you want.
If that doesn't work for you then I'm out of ideas. Not sure there is anything out there that does what you want out of the box other than a DAP device which you've indicated you don't like for cosmetic reasons.
Good luck!

