Is ground noise really normal? If so, why?

I was playing my turntable for my kids tonight and remembering how amazing it is. But the ground noise between tracks was really bothering me and my kids asked what “that noise” was. I can’t imagine it’s not there during the songs. Am I missing something or is audible ground noise completely normal? I’ve had the tech over and I recall he thought it was normal. My turntable is a Clearaudio Performance DC and my phono preamp stage is a P-5xe Twenty. 

If this is normal, why? And are there companies out there that make phono stages that have no ground noise? It’s 2019 for godssakes.