Best way to handle this ground loop

This might have been questioned a lot but I can’t find a proper answer for this: 
I have two components that form a ground loop together. Both my integrated amp and my cd player are grounded and they’re connected through RCA cables.
I did all sorts of things to try and prevent this ground loop (all power cables in one strip, tried different wall sockets, even different power circuits), but nothing helped except removing the ground plug from the cd player (or the amp of course). As I saw it, it now has one route to ground, right?
So my question is, did I do the right thing here? Can’t it damage the equipment like this? Or should I have taken an other route?
Are there for example RCA cables that break this ground loop also? Please advice..

+1 on the Ebtech

Or try an iso trans.
One thing for sure, "different" outlets create loops, never eliminate them.
Any ICs that break the loop also break the signal, with the probable exception of balanced.
Not a problem. Cannot damage. No, there are no RCA without ground. 

Whether in Europe or US power is the same in that they all use redundant ground. The first ground is through the neutral wire that completes the circuit. The redundant ground is earth ground. Millions of homes here in the US are wired with the older single neutral ground. Not a problem. 

RCA cannot work without ground. The outside is ground, the inside hot, break either one and no circuit no sound. You did the right thing. There's more expensive solutions, highly recommended too by all the guys around here with money to burn. If that's you, go for it. Otherwise, relax, pat yourself on the back for finding a creative solution that cost almost nothing.
Would you trust MC over the President of Jensen Transformers with your life? His advice is morphing from unsound to unsafe. lol

Take a look at pages 6 and 7 in particular:

"In the professional audio and video fields, the cheater plug has been identified as a serious safety problem. Its casual use as a method for avoiding ground loops in analog audio and video signals (to eliminate hums and buzzes) is dangerous.Bill Whitlock, president of Jensen Transformers, writes, "never, ever use devices such as 3 to 2-prong AC plug adapters, a.k.a. ’ground lifters’, to solve a noise problem!" Whitlock relates how an electrical fault in one device that is connected to its electricity source through an ungrounded cheater plug will result in dangerous, high current flowing through audio or video cables. Whitlock notes that in 1997, consumer audio and video equipment electrocuted nine people."

Even PS Audio recommends using a HumX to safely lift a ground. They state "It is not recommended to run your equipment ungrounded, for safety reasons."