Take it on faith: A cease-and-desist letter to those who only believe in measurements


Faith is a firm belief in something for which there is no proof (https://www.merriam-webster.com/dictionary/faith). Faith is often considered to be distinct from and even contrary to science. I argue science is based on faith. Specifically, it is faith in the belief that measurements are always correct, and they alone can reveal the world around us. However, there is no evidence that this approach will always provide a correct and complete depiction of our environment.

I am not anti-science. In fact, I am all about science. I was a science major in college. I taught high school biology and chemistry. I employ science every day in my current career. I also use it to make decisions when it comes to audio, and I can point to a scientific basis behind my equipment decisions, speaker/listener locations and room treatment. I believe John Locke’s scientific method is a wonderful boon to mankind.  But although data may rule my life, I know that science has its limitations.

The scientific method is an empirical approach and relies on our eight senses or extensions thereof to measure phenomena, enabling us to better understand and control our environment. People who embrace this approach believe if something cannot be measured, it cannot exist. They have total faith in this approach and deny the credibility of others whose senses do not or cannot yield something in units. In essence, these disciples take it on faith that measurements are the only true way to make sense of the world. However, we just may not have developed the instrument that enables us to measure the event. Early digital is a good example of our senses superseding the limitations of our understanding of the technology and hence, our measurements. Other examples of this include our past beliefs that we could destroy mass, that the earth is flat, and the universe is not expanding. And cables and amplifiers all sound the same.

Others find their senses can reveal events that are not apparent to some and may not even be measurable. Some people can smell faint odors or feel a slight breeze that others cannot.  My wife can find a Petoskey stone on a beach out of thousands of rocks; I cannot see it even when I am standing over it. Different cables, fuses, amplifier topology, or cartridge design may or may not result in the same or even any data points and may or may not sound alike. But just because you cannot hear a difference nor measure a difference does not mean there is no difference. Beauty is in the eye of the beholder, just as good sound may be in their ear.

Some of us have at least as much faith in our ears as we do in our REW software and associated hardware. I start room setup with acoustic theory and then confirm with measurements, but the final placement is always a result of what sounds most pleasing. I would not know how to determine speaker toe-in using a microphone.

While I will always have to trust my senses, I am not handicapped by relying solely on those that are associated with a number.

 “…not everything that can be counted counts, and not everything that counts can be counted.” William Bruce Cameron, 1963

tcutter

When I refer to measurements, I’m talking about acoustic room behavior, not gear specs — early reflections, decay times, and frequency response. Once speakers are in a room, those factors dominate what we hear.

Where I agree with much of the criticism is that current tools like REW and OmniMic often present measurements as isolated charts. Each chart can be useful on its own, but for newcomers especially, they create visual overload, lack perceptual context, bury left/right symmetry issues, provide no clear “good enough” stopping point, and rarely point toward concrete corrective actions. The result is a collection of data islands with no causeways connecting them.

My approach is an attempt to build those connections.

I start by measuring the three main acoustic pillars — early reflections, decay time, and frequency response — using consistent frequency banding. For each pillar, I evaluate left/right symmetry and left/right deviation from a target. Those deviations are then converted into severity scores that reflect perceptual audibility, not raw magnitude.

This matters because audibility is not uniform. A small mismatch at 2 kHz can be far more obvious than a much larger difference at 40 Hz. Likewise, a loud, asymmetric early reflection in the first few milliseconds is far more damaging to imaging than a later, quieter one. Perceptual weighting accounts for this by emphasizing deviations where our hearing is most sensitive and down-weighting those where it is more forgiving.

Because these three pillars are normally expressed in incompatible units — milliseconds, decibels, and energy-versus-time plots — their deviations are first normalized to a common scale (for example, 0 = within tolerance, 1 = clearly problematic). Once normalized, a decay issue, a reflection asymmetry, and a frequency-response deviation can be compared directly — not by how dramatic they look on a chart, but by how likely they are to be heard.

That normalization makes prioritization possible. Instead of asking “What looks bad?”, the question becomes: What is most likely audible, and what should I address first?

Once issues are ranked by perceptual severity, measurements stop being abstract graphs and start functioning as a map. High early-reflection severity points toward sidewalls or front/back walls. Overlong bass decay points toward corners and boundaries. Frequency-response issues, once major asymmetries are addressed physically, often point toward placement refinement or DSP/EQ.

Used this way, measurements don’t replace listening — they give structure to it. They connect the charts, reduce guesswork, and help translate data into decisions rather than endless tweaking.

That’s the intent behind the weighting, normalization, and prioritization — not faith in numbers, but a way to make them more useful.

Great post!

Exactly what i lived through when i tuned my room using mechanical resonators, tuned by ears and located at specific place in bundles...

Instead of using varieties of DSP i used my ears, in the process i learned basic acoustics with my "body" and ears ...

Acoustics rule audio experience not so much  the specs of the amplifier which matter for sure for synergy reason with the system...

When I refer to measurements, I’m talking about acoustic room behavior, not gear specs — early reflections, decay times, and frequency response. Once speakers are in a room, those factors dominate what we hear.

Where I agree with much of the criticism is that current tools like REW and OmniMic often present measurements as isolated charts. Each chart can be useful on its own, but for newcomers especially, they create visual overload, lack perceptual context, bury left/right symmetry issues, provide no clear “good enough” stopping point, and rarely point toward concrete corrective actions. The result is a collection of data islands with no causeways connecting them.

My approach is an attempt to build those connections.

I start by measuring the three main acoustic pillars — early reflections, decay time, and frequency response — using consistent frequency banding. For each pillar, I evaluate left/right symmetry and left/right deviation from a target. Those deviations are then converted into severity scores that reflect perceptual audibility, not raw magnitude.

This matters because audibility is not uniform. A small mismatch at 2 kHz can be far more obvious than a much larger difference at 40 Hz. Likewise, a loud, asymmetric early reflection in the first few milliseconds is far more damaging to imaging than a later, quieter one. Perceptual weighting accounts for this by emphasizing deviations where our hearing is most sensitive and down-weighting those where it is more forgiving.

Because these three pillars are normally expressed in incompatible units — milliseconds, decibels, and energy-versus-time plots — their deviations are first normalized to a common scale (for example, 0 = within tolerance, 1 = clearly problematic). Once normalized, a decay issue, a reflection asymmetry, and a frequency-response deviation can be compared directly — not by how dramatic they look on a chart, but by how likely they are to be heard.

That normalization makes prioritization possible. Instead of asking “What looks bad?”, the question becomes: What is most likely audible, and what should I address first?

Once issues are ranked by perceptual severity, measurements stop being abstract graphs and start functioning as a map. High early-reflection severity points toward sidewalls or front/back walls. Overlong bass decay points toward corners and boundaries. Frequency-response issues, once major asymmetries are addressed physically, often point toward placement refinement or DSP/EQ.

Used this way, measurements don’t replace listening — they give structure to it. They connect the charts, reduce guesswork, and help translate data into decisions rather than endless tweaking.

That’s the intent behind the weighting, normalization, and prioritization — not faith in numbers, but a way to make them more useful.

 

It's been stated here in different ways, but I know measurements are often used to argue one speaker is good and another is bad. This argument fails to measure things such as the recordings or my ears. So when people pull the 'science' card, they can in fact be completely wrong because they failed to account for everything.

@bartsw 

So when people pull the 'science' card, they can in fact be completely wrong because they failed to account for everything.

Also whenever anyone uses the phrase "the laws of Physics", it reveals a naive understanding of the subject. Physics has long moved on from absolute laws laid down by God to models of reality with inherent limitations.