Why is Double Blind Testing Controversial?

One reason blind (or double blind) testing is controversial is simply some folks won't admit that the $500 (or more, sometimes much more) cable they just bought doesn't sound any different from the cheaper brand.

Let's face it, the guy who says his jaw dropped when he installed his newest (and more expensive) piece of equipment, and then can't id that same piece when he can't see it is the reason blind testing has never been accepted.

I believe there are differences between some components, but not to the degree some people claim.

Although I have nice components, including all tube electronics, planar speakers, and listen more to vinyl than digital, I have never cared for spending hundreds or, in some cases, thousands of $$$ on cables, power conditioners, or power cables.

From all I've read, not one double blind test has ever given credibility to audible differences in cables.

What really gets on my nerves is someone who starts describing the differences he hears with components auditioned weeks or months apart. Sorry, our auditory memory usually doesn't last more than a few moments.

Jim

I think that double blind testing was invented to confuse people, and put them in a state of mind that is too over-stressed to "perform under pressure". This virtually ensures the confused outcome which is interpreted as a "scientific proof" that he can't tell the difference between products. It is mainly used to justify the psychological and financial need to not spend money on gear, but still be convinced that you have the best, without having to pay for it. The cover story is that the audiophiles who can hear something are "deluding themselves" psychologically about hearing the differences. I maintain that the ones who don't want to spend money are "deluding themselves" into not hearing differences. So who's right?

I wonder if a real "blind test" is what is meant here. Certainly swapping any component in and out of your system will allow you to get an idea of what difference it makes. You will even be able to describe the difference, and note it for future reference. Nothing controversial about that. But a "blind" test involves hiding the identity of the component from the listener, who then chooses his or her preference. There are several things wrong with doing it this way, aside from the practical problem of finding someone you trust to swap components in your system while you are unable to observe him.

One theory has it that we are better equipped physically to notice similarities rather than differences. And as you say, the choice for the long term should be made on the basis of a longer term listen. Otherwise we may listen for the wrong things... at worst, for hi-fi and not for music.

Drubin's right about double-blind: it means that nobody in the room knows which is which. And researchers use it because they've learned that there are all sorts of ways that someone can subconsciously indicate which is which to whoever is actually doing the comparing. If you want to be absolutely sure that there's no outside influence (intentional or not) and that you're making your decisions based only on the sound, double-blind is essential.

That said, the main reason DBTs are controversial is that they tend to produce results that are at odds with the received wisdom of audiophilia.

Blind testing serves no useful purpose. It presumes that by switching cables in and out of ONE system, that you will uncover something fundamental about the cables. I think not.