Simple way to play hi-res files

I'm attracted by the sound quality and storage convenience (no plastic cases) of hi-res downloads such as those available from HDtracks and am looking for a simple way to store and play them. Please forgive the newbie questions.

I'm aware of music servers such as Olive but think there must be a simpler/cheaper way. I don't need things like internet radio or the ability to rip CDs. (Maybe someday I'll copy all my CDs, but that's way off.)

My current SACD player (a Maranz) lets one plug in a USB key and play audio files, but it's finicky and supports a limited number of audio formats. Are there newer players out there that let you attach an external hard drive that you can buy at any office supply store and read the contents? That's about the simplest scenario I can imagine.

If I have to go with a music server, I'd appreciate suggestions. I care most about sound quality, supporting a wide variety of formats (especially lossless ones), rather than bells and whistles.

Thanks!