Balanced/Unbalanced --- Whats the difference?

Hi Im not a tech head.

What I want to know is what's the diffence between balanced connections and RCA. Is balanced substantially better and why?

If I buy a brand like BAT (integrated) and use RCA to connect to my CD Player, am I underutilising its capabilities?

Thanks