What turntable in the $2500 range?

I just took a quick look at the listings here at Audiogon to see what is available that might work for you.  There are a few VPIs, an HW-19 MKIII listed at $1500 with a Jelco arm that if it appeals and is in good shape would probably be my first choice.  I have one playing the Goldberg Variations with an SME 3009 Series II w/fixed head shell as I compose this note.  I have owned this TT since buying it new in 1986.  I also have an HW-40 and a Technics SL 1200 GAE so my ears are trained by those references.  I had a Prime that was heavily modified that I traded for the HW-40.  I never could get happy with the Prime for some reason.  TTs are personal, nobody can put their finger on exactly what they like about the ones they like.  One other thing I should mention is that my GAE has a removable headshell, my VPIs both have fixed headshell arms.  My SME arm had a removable headshell, but last year when I had the arm rebuilt I had it converted to fixed by SME Canada.  I also set up a lot of TTs for friends.  Across the board fixed headshell tonearms outperform removable ones.  They track better, have lower distortion for a given VTF, which is measurable and audible particularly heavy bass on the inner grooves of records that have material recorded there.  There is no question that having a removable headshell is convenient, though, so you will have to decide what is more important to you, optimal performance vs. greater convenience.  In addition to the HW-19 MKIII, there is a MKIV also worthwhile and there is at least one Classic 3 that might fit.  I didn’t see any at present, but you should also look for a Technics SL1200 or 1300.

Ya, Technics have removable headshells. Other brands don't like the extra connection points. 

The Technics 1300 G is $4000K , op stated $2500 range

Aside from other Technics models with removable headshells ,  there's the Music Hall Stealth,  Denon DP-3000NE , and I think some Thorens models that you might consider checking out

Bill, yours is the first data based report I have ever seen on the performance of tonearms with removable headshells vs those that don’t provide that feature. In interpreting such data one must be cognizant of other differences between any two tonearms that might affect the measurement and also the comparison ought to be done with the very same cartridge mounted on each tonearm when measurement was made. Can you comment? The only difference I’ve ever felt confident about, and it’s wholly subjective, is that with very low output cartridges, fixed headshell with continuous wiring back to the phono stage seems best.

Choosing a TT with removing head shell will reduce the options but it is a matter of personal choice. A used Technics as others suggest may be the best option if you go that route. As for the other options you mention, Rega is a nice plug and play option, but from personal experience , will not give you the warmth you are looking for.