Why is Double Blind Testing Controversial?


I noticed that the concept of "double blind testing" of cables is a controversial topic. Why? A/B switching seems like the only definitive way of determining how one cable compares to another, or any other component such as speakers, for example. While A/B testing (and particularly double blind testing, where you don't know which cable is A or B) does not show the long term listenability of a cable or other component, it does show the specific and immediate differences between the two. It shows the differences, if at all, how slight they are, how important, etc. It seems obvious that without knowing which cable you are listening to, you eliminate bias and preconceived notions as well. So, why is this a controversial notion?
moto_man

Showing 5 responses by wellfed

Twl, thanks for taking the time to clearly articulate what is obvious to many of us, some products are superior to others and the decision is usually, whether the improvement is worth the cost. Also, thank God, there ARE superior products that cost less than the competion. Then there is also the issue of synergy and the proper matching of components. Judging from your system profile, it's obvious you are doing your homework. God bless.

TRUTH is controversial, to be sure - follow this link Audio Asylum post concerning hyperbole
I do not know why it is so controversial, but I can tell you it is irritating. Many who preach this methodology are so dogmatic about issues such as placebo effect, being deceived by snake oil salesmen, and the physical science behind a given product that many are insistent that audiophiles that don't apply this methodology are deceived.

Subjective audio enthusiasts know from personal experience whether one product sounds better than another to them and whether the cost to benefit ratio is satisfactory or not, albeit a personal matter for sure.

So I guess the rub is in their insistence that their scientific method is the only valid approach opposed to making a decision based on simple listening tests alone. I personally would not make a decision any other way. Why not just let each other make our own judgments with whatever method of comparison chosen.

I am certainly not opposed to folks voicing their opinions and findings (I am sure this is the reason most of us read Audiogon posts), but to insist that others are deceived, misspending their money, and acting irrationally is just plain unbecoming behavior in my estimation.
Hearhere, again why the need to insist or imply that the average audiophile is deceived. What are the "many factors that drive preference in addition to sound" besides ergonomics, convenience, and build quality.

In a Utopian sense I love the idea of DBT, I doubt I would ever take the time to evaluate a component this way however. It just isn't efficient or necessary for me to do so. I have no difficulty accepting, even admiring, someone's efforts to evaluate upgrades in this manner, but so many of the conclusions/preconceptions of some DBT disciples (or claimed disciples; see below) are so clearly absurd, then to have these faulty conclusions presented so forcefully as truth is somewhat vexing, if allowed under one's skin. I would expect the converse to be true as well when called names.

I also believe that many identified as DBT disciples probably are mislabeled and really should be identified more accurately as skeptics hitching themselves to the DBT banner. It would be interesting to find out how many in this category truly practice DBT methodology. Presumably these are the ones that subjective audiophiles find to be ignorant and grating when addressing issues that contradict truths revealed to the subjective disciple based on their personal experience. The subjective conclusion would be supported by DBT if all variables were controlled, assuming of course that subjective disciple is not deceived. What what this thread all about again?
Sean, my response to Hearhere pertained to his/her first post. While Hearhere, in my eyes, appears to be one of the more honorable, reasonable, and sincere of the DBT suporters, there is still a significant insinuation that audiophiles, as group, are subject to powerful forces of deception, along with the insinuation that such deception is prevalent. As for knuckleheads, I would suspect that they are present in both camps. It would be nice if someone could devise a DBT to determine who the knuckleheads are, but for the time being I think it best to determine these by simple subjective discernment. I truly hope I am not getting too nasty with my commentary, sigh.