Startling AI results.


Shocking might be a better word. So I asked Google AI “what is the weak link in this system: a,b,c,d?” And I listed my streamer/dac, amp, speakers, and cables.  No hesitation— the weak link was my speakers. Though good, they were older and couldn’t resolve to the level of my streamer and amp.  

Then I changed one word; instead of “what’” I said “which is the weak…” again no hesitation, but this time it was the streamer.  The speakers were excellent and would mercilessly (their word) expose any weakness upstream.  
 

Then “who is the weak…”. Any guesses? The cables. 
 

I’ll remember this next time I seek medical or financial advice, lol. 
 

 

tomaswv

As described above, the accuracy/relevance of the responses, rely on precision prompt engineering. I load a pre-scripted prompt into an AI LLM before I start asking questions. It's fairly comprehensive, which is why I just upload it as a document beforehand, describing exactly how I want the LLM to behave. An extract that some might find useful when interacting with the likes of ChatGPT is the following:
 

You are a meticulous and detail-oriented assistant. Your task is to comprehensively analyse all data provided, rigorously validate every detail against the provided documents or sources, and ensure that your response integrates every relevant aspect of the user's request.

 

Even when asked about a specific detail, do not neglect the greater context or other requested elements. Cross-check all sources, avoid assumptions, and provide accurate, cohesive, and contextually complete responses. Revisit and validate every response against the user's supplied information to ensure accuracy and completeness before finalising.

 

Your responses should balance technical depth with clarity, ensuring that both novice audiophiles and experienced enthusiasts can benefit from your insights.

 

Take a “consultancy-first” approach to all questions – without compromise. Assumptions and/or conflation should be highlighted when not 100% verified.

You must operate under a verification-first principle.

  • Only provide information that is directly verifiable from primary sources (official manuals, data sheets, manufacturer websites, or peer-reviewed/technically authoritative references).
  • If information cannot be verified, explicitly state: “This cannot be confirmed from reliable sources.” Do not guess, speculate, or conflate.
  • Treat user instructions as absolute: do not simplify, assume, or gloss over details. NO Assumptions or Conflation allowed.

When your opinion is asked, act as an industry audiophile specialist and provide specialist knowledge backed by decades of experience, evaluation, understanding of technologies, market dynamics, manufacturers and user experiences.
 

A lot of the open AI for general use has some randomness built in to avoid boring replies.

Your post led me to do a similar search based on my (digital system) components (Eversolo T8, USB connection Esoteric K-01XDSE Cary SLP 98, Conrad Johnson CL 62SE, Rockport ATria II, Cardas cables).

The AI overview included nothing unexpected - amp might be slightly underpowered (OK but I could lift it!) and that, plus the SLP 98 and Cardas cables might be slightly dark rather than hyper-detailed.  The overview did include - USB does not carry a master clock signal, so the data is completely managed by the Esoteric’s internal processing. Because the Esoteric is so brilliantly engineered for isolation, "upgrading" the digital transport or the USB cable is unlikely to change the overall sound. 

I then changed the amplifier to the Pass Labs XS 25 and got this warning - Your digital connection setup is the most notable weak link. While you have stellar components, using a standard USB cable to connect your Eversolo T8 to the Esoteric K-01XD SE bypasses the Esoteric's proprietary tech ... The Esoteric K-01XD SE is a world-class CD player and DAC featuring Esoteric's cutting-edge Master Sound Discrete DACs and VRDS-ATLAS transport. However, USB is often the noisiest and most jitter-prone input. [1, 2]

and recommended that I try I²S or AS/EBU.  It also stated that the T8 had a 10MHz clock input.  Also recommended were balanced cable from the Cary to the C-J.  Both of which are SERCA only!

1) The DAC's USB input specifically uses the DAC's own clock, eliminating any jitter in the source and has highly developed isolation from noise.

2) The K-01XDSE does not support I²S input ...

3) ... nor does it have AES/EBU.

4) the T8 does not have a clock input - the T10 does.

So, in summary, changing the amp caused a totally different - and manifestly incorrect AI overview to be produced!

Caveat usum intelligentiae artificialis..