Check out Doma Bar, in Burlington: https://www.doma.bar/
The previous incarnation was pretty cool, if a little uptight. Local audiophiles may well be found here.
I'm in NH at my summer place all season and have a decent system there. You're right it's especially hard to find interersting used gear in NH or VT. Boston or Montreal are the best options for company, as both have long, deep audiophile traditions. Having grown up in both cities I can attest. Adam Gopnik wrote a great piece in the New Yorker a while back covering Montreal's special affinity for audio . . .

