Well, my local public library has book sales every month, and donated vinyl in bunches can often be found, especially on the classical or contemporary light jazz side of things (I mean, how much Helen Reddy and Kenny Rodgers do you need?). How does 10 cents apiece grab you? Yep, for Mercury Living Presence, et.al., too. O.K., that's the "bulk" price -- a whopping quarter each if you just want two or three.
I also recently bought my first CASSETTE deck(s) since my Concord portable in 1970 -- virtually pristine Nakamichis: CR-1 and CR-3 -- off original owners from eBay for comfortably under $200 total. Libraries and individuals are giving cassette tapes away by the boxful. In my case, I like to walk late at night (a Sony Walkman, among other options, can come along); and I'm a musician on the lookout for good songs I may have missed... so the strategy is worthwhile, at least until we are carrying the "Cloud", music-wise, with us everywhere.