You can use USB or many budget streamers like Blue Sound come with or can have memory added. But in general most steamers are moving away from having internal memory because on line streaming services like Qobuz and Tidal have as good or better sound quality and are so inexpensive.
I would get the best quality (depending on the rest of your system) streamer you can and just use USB connected drive. Once you start streaming, you’ll probably not use your stored files any more. ,