What should be mandatory in every professional published review-


When testing a company's newest amp, preamp, etc, and it is a refinement of a prior product that was on the market, ie, a Mark II, an SE version, a .2 etc, it should be mandatory that the review includes a direct comparison with the immediate predecessor. IMHO, it's not enough to know ion the product is good; it's also important to know if there is a meaningful difference with the immediate predecessor.

I'm  fan of Pass Labs, and I just looked at a review of an XP22 preamp. I find it very disturbing that there was no direct comparison between the XP22 and the XP20. And this lack of direct comparison is ubiquitous in hi-end published reviews, across all brands of gear tested. I don't blame the gear manufacturers, but rather the publications as I view this as an abdication of journalistic integrity.

 

Opinions welcome- 

128x128zavato

First, do you believe any of the reviews done by the magazines? They have been so biased for decades and even getting worse. When was the last time you have seen a negative review? Never! Most reviews end in “the best I have had in my system”. I’m just elevating what other people have said in other posts that I agree with.
As for comparing to a prior release, they use their memory or notes which you can’t or shouldn’t do.
I would like to see a real review when they compare like components and they rate them best, 2nd best, 3rd best, etc.. Exactly what occurs in other hobby magazines.

For example, most car mags have no issues giving a $300k car a 2nd place rating. There is always a better product wether you are using your ears or your hands and legs.

Where's the OP gone? What should every poster here, if they were professional, do? There's a myriad of preferences and likes/dislikes, just as in any marketplace, but @mikelavigne summed it up very nicely. You choose to read what you are looking for, since we don't have journalist and publications police... thankfully. Maybe another source can take on the role of industry critic's critic... mind you the marketplace here and elsewhere seems to do this very well already.

A few other things should be mandatory: What does the item smell like? How many total parts does it have? Can it survive being attacked by gorillas? Does the warranty cover excessive rust? How long can it float? Can its lights lights trigger a seizure? Can you sit on it? What temperature does it reach when disconnected?   Without these things being addressed you just can't take a review seriously.

How long can it float? What do you mean? In mercury? Seawater? Molten lava? 

Specifications are technical. Where's Amir when you need him?

Post removed