I think the original question about "bit rate" implied the sampling rate, as opposed to the number of bits used to encode the analog input signal.
According to Nyquist, you need at a minimum two samples per cycle at the highest frequency of interest. This is a minimum and doesn't imply that you will get a quality reproduction. The Red Book CD standard at 44.1 kHz, was barely above the minimum. The problem with it was that the recording needed to have very steep cutoff (brick-wall) filters to prevent "aliasing" distortion. The higher the sampling rate, the more gradual the anti-aliasing filters can be, and the better that is for preserving the phase relationship between the different harmonics of the instruments. Therefore, in my opinion, all else being equal (which is usually not the typical case), the higher sampling rates are better.
Since digitizing is just one of myriad ways in which the signal can be adversely affected, not all recordings will appear to have benefitted from higher sampling rates, but when all else is equal, they will benefit from it.
Also, in the same vein, the more the number of bits used to encode the analog input, the better; however, in my opinion the sampling rate is the bigger "bang for the buck". For the number of bits, anything above 24 may be wasted bandwidtth.

