Best practices when conducting a DAC comparison


Reaching out for general advice on how Agoners have compared DACs in their own systems.....

....and how you have determined the 'better' or the 'preferred' component, based on your comparison.

This will be my first in-depth comparison.

Feel free to mention whatever you believe will help and stuff I may need to look out for / be aware of.

Thank You.
david_ten

First compare the same interfaces, whether USB, Ethernet, AES/EBU or S/PDIF coax. You should obviously level-match using a SL meter. Tracks should all be .wav and high quality. Some should be non-music, like falling rain, tinkling glass, blowing wind, percussion, drums. Try Doors Riders on the Storm. Andreas Vollenwider. One track should have deep bass, one track should have serious dynamics. Limit it to 3 or 4 tracks.


Try going direct to your amps and also through your preamp or linestage with both. You may find one blows away the other if you go direct.

Steve N.

Empirical Audio

@david_ten 

Something else I did that I forgot to mention in my earlier post herein was keep a written log of the results. Seriously. I wanted/needed to "keep score" because often will be the case - especially if when trying blind testing/comparison - that in one instance you favor device A and in another you favor device B. Do that a hundred times and it could be worthwhile to reconcile the results from a written log, in addition to whatever other methods you use.
@toddverrone
The thing is, getting to know an audio system takes time.
Agreed.

I'm planning to take my time, especially with the newest component.

The A / B comparisons will be at the very end of the process.
@gdhal 

I have read and kept up with your thread. I also posted a few times.

Luckily, I don't have to worry about the return window since I purchased outright because I believe in what @toddverrone mentions in his post. I do not want to rush this. 

Thank you for the detailed response and guidance. Since you recently went through this, the list of all the steps you took is terrific and very helpful.

I'm not sure about the cold start one for me, but I understand why you did it when you explained it on your thread.
@willemj 

My methodology will (likely) not be at a level where you would consider it to be valid. If my business depended on such matters, I'd be much more thorough and particular.

So white coat it will not be. Perhaps somewhere between white coat and cigar jacket. : )