Required?
Nothing, other than they should really listen to the piece of equipment other than toss the gauges on it. You know like that one website.
What should be mandatory in every professional published review-
When testing a company's newest amp, preamp, etc, and it is a refinement of a prior product that was on the market, ie, a Mark II, an SE version, a .2 etc, it should be mandatory that the review includes a direct comparison with the immediate predecessor. IMHO, it's not enough to know ion the product is good; it's also important to know if there is a meaningful difference with the immediate predecessor.
I'm fan of Pass Labs, and I just looked at a review of an XP22 preamp. I find it very disturbing that there was no direct comparison between the XP22 and the XP20. And this lack of direct comparison is ubiquitous in hi-end published reviews, across all brands of gear tested. I don't blame the gear manufacturers, but rather the publications as I view this as an abdication of journalistic integrity.
Opinions welcome-
If the word "mandatory" is freaking people out how about each publication developing its own "template" that their stable of reviewers would adhere to in order to insure some continuity and comprehensiveness to formally reviewed products. If I were the editor of such a magazine or online publication, I would suggest the following:
Seems to me this would help the buying public make better sense of the reviewers findings. |
I would place the responsibility on the manufacturer to explain/demonstrate to their clients what is different between the former version and an upgraded or updated version. I place the responsibility on the reviewer to,
I was fortunate to have seen reviews by the same reviewer, of my new DAC and of the same manufacturer’s former DAC. The direct comparisons were certainly helpful in knowing what I should expect. However, that will mostly not be practical, as several here have pointed out. 6moons usually does a good job of making meaningful comparisons, IMO. |