To Blind Test, or Not To Blind Test, That Is The Question


 

Circa 1988 I held an issue of Sterophile in my extra-large mittens for the first time.  I have subscribed from that day till nowIn the beginning I was particularly impressed with the thoughts and words of one J. Gordon Holt (1930- 2009).  If I recall correctly J. Gordon was positively death on the idea of blind testing.  Many of J. Gordon’s thought soon became mine also.  But now after considering the ideas of Amir, via his website and U Tube channel, both called Audio Science Review, I have reconsidered my position.  Amir’s logic seems irrefutable.

 

Fred has a significant Hifi.  While in Ace Hardware he spots a power cable that seems identical to the one that is attached to his Mark Levinson amp.  Fred reasons that that power cord is limiting his whole system.  He unleashes a well-planned research effort and fixates on a cable that sells for 900 sovereigns.  A local brick and mortar guy offers him a 2 week return policy, and “poof” it’s home and hocked up.  Fred lets the cable “cook” for 48 hours and then begins “the test.”  He warms up everything, and them dawns a sleep mask.  A loved one, or friend plays a piece of music, of Fred’s choosing, 10 times randomly switching the cables such that each cable is played a total of 5 times.  After each playing the assistant takes note of which cable was used and what Fred’s reaction was.  If Fred discerns correctly 8 or 9 times and clearly prefers the new cable, it is established that the new cable has proven itself and is well worth the price.  But if Fred is able to discern the difference between the cables correctly only 5 times, that is meaningless, because he could have done that by guessing.  If Fred wants to increase his confidence in his decision, he could repeat the process, with a different piece of music in few days later.

 

So, using your ears, in your listing space, with your system, and playing your music, you are unable to document an improvement in perceived sound quality, created by a new gizmo, why would you want it?

 

That’s what I think, what do you think?

 

alwynlarryv

Long term evaluation is still the gold standard.

One thing that long term evaluation does is allow one to get used to -- to form expectations and standards around -- a new piece of gear. One gets used to it, and that can mean (a) one learns to overlook the deficiencies AND (b) one learns to appreciate the character of the sound.

It would seem that after getting used to the gear, long term, one might use the too@jjjsss invested in to compare, A/B two things that one is used to.

The question I ask myself about blind testing is not, "Is this the gold standard?" but "why not include it as part of evaluation"? I see no reason it is not a valuable part.

@thyname : if you lived nearby we could do a comparison of your expensive power cord vs. my cheap cord using my modded Quad 405/Quad 57's. Not high quality enough for you, eh?

Some of these differences can be pretty small, and can take a long time to get used to and to recognize. IMHO, it’s better to experience the smaller changes over a significant period of time, allowing for all the variables involved on a daily basis to balance out.

jasonbourne52

2,028 posts

 

@thyname : if you lived nearby we could do a comparison of your expensive power cord vs. my cheap cord using my modded Quad 405/Quad 57's. Not high quality enough for you, eh?

And this would serve which purpose for me? These are your equipment and speakers. Not mine. What will you be attempting to “prove” by such experiment?

Blind testing isn’t so much about the differences in the equipment as much as it is a test about the listener.  Moreover, just because a listener is able to perceive a difference between Product A and Product B, you can only talk about the listener’s preference for a particular product.  If you want to take the variable of the listener out of the equation, then your listener panel needs training.

Blind Audio Testing: The Scientific Truth Behind the Myth