My guess is that you are referring to a syringe that is used to put the dampening fluid into the trough near the base of the arm. I don't know if that sticky goo is silicone or something else, but, if it is silicone, it won't corrode anything. But, silicone has the property of spreading itself very thin and thereby migrating over the surface it is placed on. As you did, as much as possible should be cleaned off. If left on the arm it could attract and hold dust and that would not be good, particularly if it migrates toward the high precision tonearm bearings (unlikely to happen if you cleaned most of it up, but it never hurts to be extra careful). Otherwise, the only other concern is that this stuff gets on another surface, like wood, and causes a stain.
I would not use any kind of solvent before first consulting with Sumiko (the U.S. distributor) or SME.
I would not use any kind of solvent before first consulting with Sumiko (the U.S. distributor) or SME.