I own a Rega Apollo R and a McCormack CDP, both sound very good to me and are in your price range.
I would also think about a DAC. I reentered HIFI after a 30 hiatus, using streaming music was the last thing on my mind, but, low and behold, I am listening to it every day.
I would also think about a DAC. I reentered HIFI after a 30 hiatus, using streaming music was the last thing on my mind, but, low and behold, I am listening to it every day.