See what Dynaudio recommends. Chayro is right, you are probably working on the poly finish, not the wood. Be careful, good intentions on this can lead to unfortunate results.
What to use in polishing high quality wood speaker
I'm wondering what I should use to polish expensive Dynaudio speakers. Any suggestions?