There's also the little matter that your own hearing perception alters with volume. As the volume goes up, you should hear more highs (and somewhat more lows). At low volumes, your hearing very efficiently concentrates on the all-important midrange. This effect will swamp any impact that a volume control would have.
Sounds like you're not crazy at all. You're normal.
Sounds like you're not crazy at all. You're normal.