Why Do So Many Audiophiles Reject Blind Testing Of Audio Components?


Because it was scientifically proven to be useless more than 60 years ago.

A speech scientist by the name of Irwin Pollack have conducted an experiment in the early 1950s. In a blind ABX listening test, he asked people to distinguish minimal pairs of consonants (like “r” and “l”, or “t” and “p”).

He found out that listeners had no problem telling these consonants apart when they were played back immediately one after the other. But as he increased the pause between the playbacks, the listener’s ability to distinguish between them diminished. Once the time separating the sounds exceeded 10-15 milliseconds (approximately 1/100th of a second), people had a really hard time telling obviously different sounds apart. Their answers became statistically no better than a random guess.

If you are interested in the science of these things, here’s a nice summary:

Categorical and noncategorical modes of speech perception along the voicing continuum

Since then, the experiment was repeated many times (last major update in 2000, Reliability of a dichotic consonant-vowel pairs task using an ABX procedure.)

So reliably recognizing the difference between similar sounds in an ABX environment is impossible. 15ms playback gap, and the listener’s guess becomes no better than random. This happens because humans don't have any meaningful waveform memory. We cannot exactly recall the sound itself, and rely on various mental models for comparison. It takes time and effort to develop these models, thus making us really bad at playing "spot the sonic difference right now and here" game.

Also, please note that the experimenters were using the sounds of speech. Human ears have significantly better resolution and discrimination in the speech spectrum. If a comparison method is not working well with speech, it would not work at all with music.

So the “double blind testing” crowd is worshiping an ABX protocol that was scientifically proven more than 60 years ago to be completely unsuitable for telling similar sounds apart. And they insist all the other methods are “unscientific.”

The irony seems to be lost on them.

Why do so many audiophiles reject blind testing of audio components? - Quora
128x128artemus_5

Showing 3 responses by oldhvymec

By virtue of being on these forums and making recommendations, YOU ARE, and you know OHM (my new short form for you), that many on here are very forward in trying to convince others purely on sighted testing.

<<<<<<<<<<<<<<<<<<<<<<<>>>>>>>>>>>>>>>>>>>>>>

Listen I didn't say some folks ears didn't have an agenda. I'm just saying my ears have to please ME.. And right after me you're first...  

I like to share affordable alternatives but VERY close to the same performance at sometime literally 100 X less. 100.00 vs 10,000.00 usd, same cable .. no kidding.. Might be missing a wooden block or two..

Blind testing doesn't need to be used, for 100 vs 10,000.00 LOL who cares..  Some people that is half a week of Starbucks. take the plunge..
Blind testing has it’s place. Just not in a "Personal Stereo System".
We as individuals are NOT trying to prove to others what we hear is good to them only US. Why try to please the masses because a VERY few want to prove a point.

The issues is not the fact that the testing is good or bad, it just doesn’t have the final say or in my case ANY say in my system building.. No reason for me to use the method.. I like what I like, no need to prove it to anybody. Recommend maybe, BUT I don’t have to prove something is better to anyone.

If I was trying to prove something WAS actually different, trickery by setting terms for testing really isn’t accurate. We are humans and we can be TRICKED. Our hearing is as much a part of seeing when in concert together. NOW add feeling and smell along with a little taste of popcorn, holy moly you got a full blown skewed test because someone POPED popcorn and YOU smelled it..

That same analogy is why a trained ear for some things is ABSOLUTE. There is no other way to gather data into YOUR brain.. You have to listen with your ears, and feel through your bottom, chest, face and hands. ALL are different collection points.. ALL adding to your hearing, perception.

You really can’t measure it, but you can REMEMBER it.. Remember the phone call from a 50 year old friend, you haven’t heard from in 45 years.

You know exactly who it is as soon as they speak.. We have the ability to hear the difference, the question is does every one have that ability?

7 billion people on the planet, one person calls you from 45 years ago. You know exactly who it is...there’s a blind test for ya. That actually has a purpose.. Go figure.. Hello good buddy long time no hear, BUT I can SEE you in my minds eye.. plane as day... Memory is memory.

Have you ever remembered the tune but forgot the words, so you add your own.. Thirty years later your still mumblin’ the wrong lyrics to the same TUNE.. Wrong memory works too, you have to be able to DISCERN the difference.. Tough for some.. Actually a lot.. You have to be able to remember when your WRONG.. Some it is just impossible.. No names ay!!!

Regards
There you go again cakyol with the under breath slighted remarks that spew nothing but JEALOUSY. Not because you can’t hear the difference, but because you WON’T.. you would make a horrible mechanic.

I’d give you 3 months before they’d give you the boot for being too darn thick to learn HOW to listen.. The apprenticeship program I went through
taught you HOW to learn too.. 101... how to learn. FIRST things FIRST.

THEN to listen, and then ask questions...

Not show what you haven’t learned. You ask question until you have the proof you need, not doubt, what you obviously can’t seem to grasp...

Tough being an army of one...

No roxy54 it’s not a word ( ordinary’ness). , BUT we can LEARN to think it is.. :-)