That sticky stuff on some drivers is a dampening material, like a tar if you will, that is used to improve the driver response. It is tacky on purpose, as you sort of paint it on the cone. You cannot clean it- dust is a problem-but fortunately dust doesn't affect driver performance. So best not touch it.
TO fix it cosmetically, you have to recone the driver (start over with fresh parts and fresh dampening material) or replace the driver. Both are not cheap. If it bothers you, then Id get both drivers reconed so they look the same. Use an air cleaner (not an ozone generator which destroys rubber) to reduce dust in the room.
Don't beat yourself up, about it, I did it myself years ago before I understood.
Lone Mountain Audio
Brad