+1 on Cabinet/driver/wire are the most likely culprits
I had internal wire buzz in martin logans in both speakers. The wires will buzz either against the driver, cabinet or the crossover components. Fixed it with self adhesive weather tape in the places where wire was close to other components.