Yes Stereophile and other "golden ear" mags reviews are mostly purely subjective, emotional responses to a given product. Each reviewer has his own priorities, and uses his own goup of "associated equip" to test new products. Every reviewer uses different "assoc.equip" so you can get different results depending who is reviewer. God forbid you ever give a bad review because there goes advertising account and any chance of future reviews! Internet is great for getting reports from the field, from real users, to get a consensus on the performance of products. I don't see any change for "gold ear" mags, but internet consumer review sites are very helpful.....regards Sam
9 responses Add your response
I too share the opinion that Audiophile magazines leave a lot to be desired. In my many years of reading Stereophile, Audio Review, The High-End, etc. I can never recall a BAD review. Even crappy stuff gets some positive comments on "how great the remote is laid out" or "Nice design". I can't understand this concept. You would believe that there is really no BAD equipment out there. Assuming the piece being reviewed doesn't blow-up upon plugging it into the wall it will more than likely get a decent review. The theory that they will upset their advertising revenue stream seems bogus. If that is the case than these reviewers and editors have no journalistic integrety. You don't see Time-Warner not advertising their latest movie in a magazine like "Entertainment Weekly" because a movie critic for that publication gave one of their films a crappy review! I would love to see an audio magazine tell it like it is. "This product isn't worth the $" or "Does not do as good a job as ---- for the same $". This would be more beneficial to the reader who is interested in purchasing a piece of equipment (when not available to audition first hand). Another good idea, mentioned by a few others here, would be to have a "reference" system that ALL equipment would be tested on. Too many of these reveiwers take a piece and plug it into their own systems so the results vary from reviewer to reviewer. If anyone knows of some good audio review sites, I'd love to see them listed here.
I arrgree with everything each of my predecessors say.I challenged TAS A couple of months back.They tried to "tapdance"around using A 10year old transport,a budget dac on a 5000 pre amp.In my email to them I joked "you guys do that on purpose?'I'm sure you guys/or ladys can recall the opposite,happening as well. When I go to A Hi End Salon The room isn't anything like mine;and neither is any of the equipment being used.So I need all the help I can get.I have to rely on what the magazines write.Boy am I in trouble Avguygeorge Sorry no spell checker
Nanderson, congrats on this thread! I realised long time ago that any desigion, that involves your money and long term satisfaction, should be ultimately your own. For example: I am looking for the set of speakers, and for entairtainment purpose i picked What-hifi, british mag. Their worst graded speakers end electronics, were highly prised by stereophile. And vice-versa. Kef rdm-2, has 5 stars in What... and graded "C" in stereophile. Celestion A3 was graded three stars (mediocr) and Stereophile graded it next to the best "B". Linn AV 5140 was graded by stereophile mediocr class "C" and What HIfI highest 5 stars(not platinum) etc etc....i don't even want to go further. This is the example, if you are looking for advice from those guys...Forget about it! Read those magazines out of entertainment reasons ONLY!
NAnderson nice thread, you've hit the nail right there on the head. The magazine you refer really got to put their acts in order, but why are you still a multi-year subscriber? Courage, masochism. Many reviewers' papers are a mass of twists and turns and even backtracks over time for one major reason. The reviews are not always based on any solid scientific understanding, engineering compromise or inevitable trade off to create a hi-end product, so often not knowing how they got there in the first place. The job of a hi-end reviewer is really a tough one.
I’ve carefully read through the (so far quite few) threads which follow this ‘challenge’. However, there are a number of problems both with and without the traditionally ‘printed’ review magazines. I believe that a reviewer should be able to state the position he is in with respect to his system. For instance, if he is reviewing hi-end products (single components) I believe he/she should state what the review system is, and what the component being reviewed actually replaces in that system, thus allowing some semblance of a meaningful comparison but only in the context of that system. If you care to look back I stated in one issue of Listener (about 18 months ago) exactly what my reviewing systems are. They are still the same. This will hopefully provide something of a level playing field. In addition, (and it happens to be in keeping with Listener’s reviewing policy) I believe that reviewers should actually own the equipment they use to do their reviewing. This will at least bring to the forefront of their minds the realization that comparatively few can afford to go out and buy a truly hi-end system and still have enough left over to add to their music collection. I think every reviewer should be made to declare his owned equipment, and also his loaned equipment. It is also well-known that some reviewers also work within the industry. For some (like me, who deals with thermionic technical issues all day) the reviewing comes as a welcome break after having a head full of theories and flickering scope displays. Some others actually design for companies and then get paid as well. A disclosure of interests should be manadatory, so we can really see which side their bread is buttered. And moving on, some reviewers have very good technical knowledge, but know stuff-all about music, let alone what live music sound like. I believe that where a reviewer has only one area of knowledge, that should be the only one they’re allowed to comment on. I remember one review very well where the reviewer commented on the clarity of the oboe’s tone. It was a clarinet on the recording he used! If a reviewer has no technical, or no musical knowledge then they should not comment on it. After all, do you know what it’s like piloting an Apollo space shuttle? For my part I am a qualified electronics engineer, and also have an excellent music degree, and am a practising musician I also believe that reviewers should have integrity. They should not only say what they truly believe about a product (with some form of managed feedback from the manufacturer if the conclusions appear to be way off-beam) but also, they should not write simply to ensure a continuance of advertising revenue. However, despite all this philosophy, at least the printed reviews have behind them a nominal accreditation from the organisation putting out the publication. However, mistakes do still occasionally happen. The Impulse Kora is a stunningly good ¼ wave speaker, but it was given to a reviewer who traditionally uses 100watt amps in his system. The Kora is 92/93dB/W efficient, and under that sort of use the speakers just didn’t stand a chance. However, if you partner them with lower power amps (either solid state or tube) the speakers will really sing. The bad review (of a good product) killed the speaker design stone dead. Those who bought them still have them, mostly. Very few of the 1000+ pairs sold every reach the second-hand columns, and if you find them they still cost $1200, what they were new, 5 or 6 years ago. So the mags have to be sure that every product is given a good and fair auditioning with sensible partnering equipment. After all, you wouldn’t test-drive a Trans-Am with a caravan hitched up behind would you? However, some of the dangers with the net forums is that these areas are even more subjective. If you read printed reviews for long enough you should be able to get inside the head of the author and work out where he/she/s coming from, but sometimes results are contradictory. And most reviewers seem to have ‘this week’s sliced bread’ all the time, so where’s the consistency? But the Net is even more open to highly subjective comments, and also to ‘creative marketing’. Ever seen a glowing tribute to such-and-such a pre-amp, only to find the correspondent selling it in the Ads section? It happens. And lastly, if you sit and think about it, no worthwhile manufacturer is going to actively sell something which doesn’t stack up to the claims. It’s one thing to miss you own benchmark (which rarely happens) but as audio is so subjective, other things come into play; imaging, bass slam, pace, rhythm and timing (whatever they are) soundstage and so on. Since no-one can measure those, they’re a mite difficult to quantify in a meaningful way, but power output specs and so on are measurable. Quite often (like the first Hitachi solid state power amp) it measures well, but doesn’t sound good. You can’t condemn the product on its tech spec, only on audition. Things have to be kept sensible here. There’s no easy answer. As a starting point I believe (and practise) the following: 1 reviewers should have unimpeachable honesty and integrity in everything they write 2 they should own their basic system(s) which should be noted and used as a continuing reference (the only exception being a ‘whole system’ review) 3 reviewers should disclose any industry association / affiliations, and benefits (long-term loans, design contracts etc) 4 there should be scope for ‘bad’ reviews, with a right of reply 5 reviewers should stick to what they know 6 all equipment reviews should partner the review product with appropriate ancillaries 7 the reviewer should not benefit (or lose out) as a result of the conclusions of the review If you want to contact me, feel free; [email protected]