Welcome to the world of vinyl! I'm sure you will enjoy this aspect of the hobby, and I am sure you will be really glad you explored it, when you hear how vinyl sound when reproducing music in your home!
A tip on shopping PREX for vinyl: for a while, stick to the "new arrivals" bins (on the left if you are facing the back of the store). Lower pricing, and a mix of mainstream and obscure music. Prices usually range from a low of 1.99 to 9.99. Check the condition of each LP. Pricing has as much to do with the label and relative availability as it does with surface condition.
Regarding the 1.00 bins: more of a crap shoot there, mainstream and obscure, good and bad shape. Shopping the 1.00 bins, takes the desire and willingness to sit on the floor in the dirt and dust, the ability to allow yourself to get stepped on and over for the rewards. There have been times when I have left there with 20 LPs for 20.00, other times, one or two. Last week, I got a VG+ condition Marshall Tucker Band debut LP on Capricorn for a 1.00.
The main bins, arranged by artist and genre, have been filling up of late with new sealed stuff that can be bought online for less.
A really good place to shop for used vinyl at great pricing are Library Book Sales, as well as your local Goodwill outlet.
Best of luck to you in your pursuits. Just remember, the ends justify the means when you come across that great recording, and drop the sylus for the first time.