Why is Double Blind Testing Controversial?

Sad, isn't it?

I once blind tested a Ford and a Chevy. With the Ford I bounced off a cop car, hit a little old lady in a crosswalk-- she survived, and ended the test by crashing into a garbage truck. The Chevy was much better in most respects, I only killed a dog and the test administrator was taken away in a straight jacket. When released from prison I bought the Chevy, which was then 5 years old but the radio still worked and the car was well broken in. Anyway, this experience caused me to be skeptical of blind testing. My loss I suppose. Cheers. Craig

Moto man, I do not question the importance of cable comparisons.

What I question and challenge is the notion that an objective BLIND comparison can be set up for audio cables. Without an objective measurable (user perception is not a valid, reproducible measurable), it is not a valid blind test and has no objective validity.

Subjective observations that are presented as "objective" are exactly what lead people like Elmuncy to spend money on things which disappoint.

Some years ago I agreed to test prescription eyeglasses for Pearl Vision. Several pairs were switched while I kept my eyes tightly closed. I immediately choose the "perfect" pair, that were very reasonably priced.

After a day I had a horrible headache and was forced to keep my eyes closed to enjoy my new glasses.

I like to shop for audio this way too. Make a decision based on a quick test, make myself miserable and then quit listening so the headache goes away.

Tobias and Redkiwi hit it on the head. It takes prolonged exposure (post burn-in, which a lot of A/B's may not do) to really absorb the differences. "Night and day differences" aside, most A/B's are a matter of trade-offs -- e.g., a little more bass punch vs. a little less definition. What seems very nice in the short term may not be preferred longer term. What seems like a strength listening to one recording may not seem so while listening to another. In reality, all of our choices are A/B. We are replacing what we have with something else we believe is "better" after prolonged listening. That's why companies offer 30 day trials rather than 30 minute trials. From my understanding, most A/B tests tend to be 3 minute trials. Sorry, I'm just not that good.

By the way, none of this is to say that I don't harbor a secret fear that I'd pick Bose ;-) But, I have heard too many say that, with prolonged exposure, they can pick out component signatures from a distance without seeing the actual unit/cable being used.