where to start analog

I will let others recommend specific products since some here seem to have tried everything. Not that ohers will, but neither Albert nor Twl will lead you astray with respect to vinyl. I have my favorites, based on my satisfied, though relatively narrow, experience.

Not that spending more always equals "better" but I would recommend buying the best quality/value you can afford from the "git go". If you do decide to go the more "basic route", as a beginning, buy used from someone you can trust (like here on the 'Gon). That way, you can usually get back close to what you paid and apply that money to the inevitable upgrade you will want after getting back in to vinyl (said loudly from the voice of experience) ! :-)

I also just got back into analog with a Rega P-25, Herron Audio MC Phono Stage, and a Dynavector 17-D II Cartridge. About $5,000 if you buy all new (I did not). The only system I have ever had, that has brought tears to the eyes of a dinner guest!

Someday I will probably up-grade the TT to a Teres or something of that quality. The rest of the components are "keepers."

Good luck with yours.

Definitely consider used. People tend to take very good care of their expensive equipment.
For $850 I picked up a used VPI hw-19 mk3, with rega rb300 and sumiko blue point special. I then purchased a demo monolithic phono amp for $300. So for a total of $1150 I believe I got a setup that is far better than anything I could have bought if I bought new.