PC Challenge Test Results


As a result of the "PC challenge" thread, I've now had a chance to put a high-end aftermarket PC to the test in my system. First, sincere thanks go to Albert Porter for helping to set up the test, and especially to Jim of Purist Audio for his hospitality in loaning me a PC. Jim also was quite gracious about how long the testing took.

Jim sent me one of his Dominus power cords. This PC clearly uses very, very high quality components and the level of construction appears outstanding; this is certainly a PC at the highest level. I'd guess that you could jump-start a car with this wire! I don't know if this cord costs $50 or $5000 (bet it's closer to the latter), nor did I want to, to avoid possibly influencing the test.

My initial listening took two approaches. After having powering-up the cable for 72 hours as was recommended, I listening in a very relaxed manner, without trying to identify any specific differences. Did my system seem more or less enjoyable than I remember? The answer is yes, it did seem more enjoyable; there seemed to be less "stuff" getting in the way of the music perhaps, a clear although not huge difference, and there also seemed more of a foundation to the music. The question then became whether or not I could pick out specific differences? Again, compared to my recollection of the system sound the answer is yes. While the changes were relatively subtle there appeared to be more and better bass (slightly deeper and more defined, more of a visceral impact) and the vocals somewhat more natural - less "in your face", perhaps. The lack of bass depth is an inherent shortcoming of my system, but the vocals had never stood out as a problem area before. Overall, the sound seemed more transparent, quite a feat given I think that's one of the primary strengths of my system. Bottom line for this part of the evaluation: the Purist PC definitely added to the system, although subtly.

Now, that being said there I had some very strong concerns on the above given that this was a sighted evaluation. It could very well have been that I expected and was listening for exactly those effects (not the vocals, though - that surprised me), or that my audio memory of the previous setup was flawed. I wanted to try some blind evaluations as a test. I have no ABX-type of setup, so was unable to conduct any tests that I'd consider truly scientific, but tried something that was informative nonetheless. With the help of my brother, we did some rapid-switch testing: he flipped a coin and either switched between the Purist PC and stock, or not. I typically listened for 2-3 minutes to the Purist before the switch/not-switch and an equivalent time after before deciding, and got 7 right out of 12 trials; we then tried it with the stock cable first and I got 5 out of 8. I've not yet hauled out my old statistics textbooks, but am pretty sure that this would fail most reasonable hypothesis (say, "there are sufficient differences (95% confidence level) between these PCs that I can identify them correctly 80% of the time).

So what does this mean? Nothing beyond that it appears, in my system, that I probably cannot discern any purely audible differences between my stock cord and the Purist. Any broader conclusion is unsupportable from my testing alone, although I do suspect that equivalent results would hold for the population at large. But - and this is a big but (no jokes, please!) - before the blind testing I did perceive an improvement in my system; for many, this is sufficient and they may gain a real benefit from aftermarket PCs. In my case, though, I'm better off adding a sub than investing in aftermarket PCs.

Cheers,
JHunter
jhunter
Thanks for taking the time and effort to carry out and report on your project. The results are not surprising and I suspect they would not be that different for any other number of other components (cables, amplifiers, isolation devices, CD transports) where the differences are, for the most part, truly subtle. Another factor to consider is not whether you can hear a difference, but whether the differences you hear are musically important. For instance, under most circumstances a lower noise floor is less important than increased harmonic coherence.

I suggest the following for a test setup: secure 2 identical test CDs and also secure 2 identical CD players. Then using identical cables feed the CD players into separate inputs of a preamp. The power cords for the CD players would be the variable and you could switch easily using the preamp input control.
Jhunter. Our thanks to you for investing the time to make this comparison and post results for all to see here at Audiogon. You have openly and honestly presented both sides of your test, and for that, my sincere thanks.

My primary concern over the blind portion of your test concerns the mechanics of frequently changing the test cords and the assistant's handling of them.

When a Purist Dominus power cord is disturbed it requires as much as three days to recover, with 20 minutes being the minimum. One last test you might make before shipping it off would be to first listen extensively to the Purist with music you are familiar with. When you are ready, walk over to the Purist and pick it up a few inches, mash it slightly with your fingers (or bend it) and let it fall back to the floor.

Go back to your original listening position and enjoy the music again. You will hear a distinct change for the worse. As you continue to listen, the sound will slowly return to the level of performance you enjoyed before the disturbance.

A great deal of your confusion with the blind portion of the test may be clarified by this last experiment. It would be interesting to see if you can identify the changes from the bend/drop test and factor them into the final results.

You were probably unaware of this variable. Essentially, you were trying to identify three sounds (or more) instead of two. The original or stock cord, the Purist cord working at it's best, and the Purist cord in various states of recovery from swapping during the blind test. This variation would make it difficult to arrive at any confident result, especially if you did not know why it was happening. Even when the same bend/drop test are performed in sighted listening sessions where the listeners are aware of the reason for the change, it is surprising to hear the results.
Nice system JHunter and also thanks for taking the Pepsi challenge. I also like HWY's test suggestion. The cords and inputs could later be switched on the players and the tests ran through again to see if the same results come up. I am certain that you must be tired of it all by now though, as there's nothing like getting back to listening to the music, instead of the gear.
Thanks, Jhunter, for taking the time to share your experiences with us. You were honest in describing what you heard, and that is a great service to this community. I share Albert's thoughts about the possible unintended consequences of the attempt to do some blind testing by swapping the cables in and out. I also experience the phenomenon that moving my cables requires a re-settling period before the sound gets back to where it was.
JHunter, I think the above posts express it well. Thanks for taking the time to run the test and providing your unbiased results.