Why HiFi Gear Measurements Are Misleading (yes ASR talking to you…)


About 25 years ago I was inside a large room with an A-frame ceiling and large skylights, during the Perseid Meteor Shower that happens every August. This one time was like no other, for two reasons: 1) There were large, red, fragmenting streaks multiple times a minute with illuminated smoke trails, and 2) I could hear them.

Yes, each meteor produced a sizzling sound, like the sound of a frying pan.

Amazed, I Googled this phenomena and found that many people reported hearing this same sizzling sound associated with meteors streaking across the sky. In response, scientists and astrophysicists said it was all in our heads. That, it was totally impossible. Why? Because of the distance between the meteor and the observer. Physics does not allow sound to travel fast enough to hear the sound at the same time that the meteor streaks across the sky. Case closed.

ASR would have agreed with this sound reasoning based in elementary science.

Fast forward a few decades. The scientists were wrong. Turns out, the sound was caused by radiation emitted by the meteors, traveling at the speed of light, and interacting with metallic objects near the observer, even if the observer is indoors. Producing a sizzling sound. This was actually recorded audibly by researchers along with the recording of the radiation. You can look this up easily and listen to the recordings.

Takeaway - trust your senses! Science doesn’t always measure the right things, in the right ways, to fully explain what we are sensing. Therefore your sensory input comes first. You can try to figure out the science later.

I’m not trying to start an argument or make people upset. Just sharing an experience that reinforces my personal way of thinking. Others of course are free to trust the science over their senses. I know this bothers some but I really couldn’t be bothered by that. The folks at ASR are smart people too.

nyev

@joshua43214 , in my non-scientist opinion you are describing the ideal mindset of a good scientist.  Scientists are supposed to be sceptical.  But at times it’s also helpful to remain at least a little bit sceptical of scientific consensus as well, especially when new data is brought forward.

@edcyn ASR = Audio Science Review.  Led by Amir, an online reviewer who suggests that subjective sensory assessments of audio gear cannot be trusted.  Therefore, he takes a measurements first approach to assess the performance of audio gear.  He ends up shooting down some equipment that are well respected by audiophiles, but fare poorly in his measurement tests. 

To his credit, he has amassed quite a following, with many people crying “snake oil”.  His followers and other audiophiles have been at odds for quite some time now…

Decades ago Peter Walker of Quad did a listening test of two amps - the Quad II tube amp and the 405. Speakers were the Quad 63’s. Music sources were 30" IPS copies of EMI classical master tapes. Reviewers were audio recording engineers and members of the British HiFi press. Nobody could tell the two very different amps apart as long as clipping was avoided. So there you have it! A well-controlled subjective listening test without measurements!