@roadcykler I am a firm believer that "bits are bits". I was a software engineer for 50+ years and worked on mission critical banking communications systems. The current estimate is that about 3*10^21 bits are moved over the internet each day, and, with error correction each resulting byte of data is received correctly.
However, the timing of when data is presented to the DAC chip(s) is critical, and with IIS the cable from source to DAC is a critical component (the clock is carried over the cable). In particular, anomalously, ultra high bandwidth video HDMI cables can interact with the DAC and cause sound quality issues, perhaps ringing in the receiver or odd reflections.
In particular OP's HDMI cable appears to be knows as a potential problem.

