Mem 916 gives great advise. You need both to fully explore all the great music out there. I have owned the Capitole II SE for 3 or so years and think very highly of it. It's a fantastic player and especially great value when you consider it can function without a preamp, I don't think you can do much better for the money on the used market.
I recently bought a Whest phono stage and a used Nottingham Horizon table with a Dynavector 10x5 cartridge (used for 700 bucks) This analog setup is so much better sounding to me than digital, it's not even close. It's almost as if the digital and analog aren't even comparable it's that much better, and I'm only at the entry level of analog, although I did get a pretty decent phono stage (2500.00 for that part)
Analog is not without it's hassels, there are going to be some pops and clicks to learn to live with and you must clean are care for your records. To me it's worth it, my interest in listening has taken a leap forward since getting into vinyl, it's so much better than I thought it would be.
You may not be able to find everything on vinyl, but there is also a lot of older vinyl that you can't get on CD. I made a visit to an excellent store (Amoeba records in Berkeley) and found the selection and quality excellent. For now I'm taking in lots of new music that may be old, but it's new to me.
Sorry to ramble on, but I just thought I'd share my enthusiasm with you. I have also owned the Prima, and while it does sound very good, it's not quite the equal of the Capitole and when you factor in the need for a preamp then the Capitole pulls ahead. If you already own a preamp that you intend on hooking up the Capitole to then get the Prima, it is about 80% of the Capitole when both are hooked up to a preamp.