Steve Guttenberg on Audiophiliac- $2500 or less many choices to play with. Then do your research. I like this guy.
I’m relatively new to audiophile level equipment myself but have a couple suggestions with links to Steve Gutenberg’s reviews. As mentioned above, he’s a pretty well known and regarded audiophile and reviews a lot of low-mid priced gear in addition to the higher end stuff
Speakers- Klipsch RP-600Ms are efficient and very highly rated Bookshelf speakers. A pair will cost ya about 500 Bucks.
For the Amp, definitely stay away from separates for now to get started. Reisong makes some decent cheap Tube Amps for a few hundred bucks if your heart is set on Tubes.https://youtu.be/vCk12xzivp8
Here’s a 950 dollar amp/speaker set up
For the Turntable I use a Pro-Ject Debut Carbon still. For the money it’s decent and comes with a Cartridge. 400 bucks.
for your cables, check out this guy:
He has great quality, a big variety and you can get really nice cables for less than buying from many other companies. I particularly like the Interconnects made with vintage Western Electric Wire from the 40’s & 50’s, they provide a nice warm smooth sound.
just some thoughts, happy hunting!
A system similar to the one @mofojo recommended would be a good option. The Tekton M-Lore is a very high value speaker and quite forgiving. I had a pair years ago. With your budget, I'd still advise against vinyl and tubes. You will be spread too thin on budget. If you do go with M Lores or Lores or something Tekton. They absolutely sound better with real wattage behind them. More dynamic with tighter bass.