do blind tests have any practical significance


do the results of a blind or double tests have any usefulness ?

a blind ab test does not prove anything. it only states facts, namely that a certain percentage of listeners were able to distinguish the sound of one component from another.

there are many issues as to the validity of these tests.

the question, "can a listener detect the sonic difference(s) between components", is never answered definitely by one test.

suppose a blind test is administered 10 or more times to the same group of listeners. assuming the first test is replicated 9 more times, there is a chance that there may be an inconsistency between the outcomes of the test.

suppose a statistically significant percentage, say less than 60 percent, for a large sample of listeners, identifies differences between 2 components, what does that mean ?

what is the application of such a result for a prospective buyer of a component ?
mrtennis

Showing 1 response by shadorne

In medicine and in science in general the ONLY kind of test considered reliable is a double-blind test. Should listening tests of audio equipment be different? Perhaps it should because the "data" is completely subjective. But this means that the test results are completely useless, so why bother? Go listen.

In the sense that a double-blind test can be used to show that a difference is inaudible even to experts....YES this is very useful to separate hyperbole from the reality about the magnitudes of difference between components.

Given two pieces of equipment that do have an audible double blind statisticaly meaningful difference, then I am with Eldartford.....the "better" sounding piece of gear is a subjective matter...some want "accuracy" which involves science and test measurements...some want the nicest sound colored to their personal preferences!

Science has no place in our hobby. We know what we know and we don't need no book learnin'.

Science and test measurements do have a place in audio, but are only relevant to a small portion of audiophiles, a much higher preportion of manufatcurers (to help design, build and QC) and to a very high proportion of sound engineers/studios.