All of what you last posted may be absolutely correct. I would like to read references.
But since there are no measurements (nor anecdotal representations), one cannot conclude that scrubbing pads affect the sound.
One might advise against using scrubbing pads for the reasons you’ve stated. However, without real data advising it, it is just a choice, not a necessity.

