The biggest problem I have with those compilations in Stereophile is that
they are based on a range of individual reviews, some of which are dated,
and don't represent actual comparisons of equipment, so any one category
can represent a variety of equipment evaluations by different reviewers at
different times that really don't really represent a comprehensive,
comparative
evaluation.
Far more informative, to the extent I'm going to rely on a professional
review (which is a separate question),would be a shoot out among, say, 4
or 5 preamps in a controlled environment (recognizing that there would
have to be changes in the 'reference system' to accomodate necessary
synergies, and a sort of roundtable review, by a panel of reviewers present
in the same room, using the same set-up(s)). Obviously, that's far too time
consuming for a magazine to do on a regular basis (though at times, it has
been done). I recall a shoot out HiFi+ did a number of years ago with then
top level line stages which, in the comparison remarks, were in my
estimation, pretty informative, since I owned one of the pieces at the time,
and the remarks were pretty close to my longer term experience in using
the one piece.
As M. Fremer said in another thread here, it's 'informed entertainment.'
Perhaps like reading a 'best movies' or 'best books' of the year, recognizing
that some of the reviews are from earlier years.
they are based on a range of individual reviews, some of which are dated,
and don't represent actual comparisons of equipment, so any one category
can represent a variety of equipment evaluations by different reviewers at
different times that really don't really represent a comprehensive,
comparative
evaluation.
Far more informative, to the extent I'm going to rely on a professional
review (which is a separate question),would be a shoot out among, say, 4
or 5 preamps in a controlled environment (recognizing that there would
have to be changes in the 'reference system' to accomodate necessary
synergies, and a sort of roundtable review, by a panel of reviewers present
in the same room, using the same set-up(s)). Obviously, that's far too time
consuming for a magazine to do on a regular basis (though at times, it has
been done). I recall a shoot out HiFi+ did a number of years ago with then
top level line stages which, in the comparison remarks, were in my
estimation, pretty informative, since I owned one of the pieces at the time,
and the remarks were pretty close to my longer term experience in using
the one piece.
As M. Fremer said in another thread here, it's 'informed entertainment.'
Perhaps like reading a 'best movies' or 'best books' of the year, recognizing
that some of the reviews are from earlier years.