I'm happy as a clam using my Windows laptop as the controller. It happily sits on my lap. It offers an image size comparable to that an old 10" record, so it's easy to read liner notes and gaze at the pictures the streaming services almost invariably provide. You aren't going to be on the move when you listen, anyway. You'll be lounging on your couch or easy chair just like you are when you play that treasured LP.
My streaming hardware, meantime, is a not terribly expensive Cambridge CXN streamer/DAC plugged into an ethernet connection/router gotten from the local phone company. Plugged into my Primaluna Integrated Amp, this 60 years+ audio nut is happy as a clam. Not only does it provide a universe of music for a modest monthly fee, it gives my SOTA Sapphire, etc. etc. analogue rig serious competition when it comes to sound quality.