Unusual probelm with my turntable

I just had my cartridge replace and now my turntable makes a buzzing sound right before the music starts at the beginning of a side. The buzzing lasts for about a second but goes away and there is no noise after. It is quiet when the amp is on or in between songs.I cleaned the connections switched interconnects and cables, but no luck getting rid of the noise. Does anyone have any suggestions or answers on what is causing this problem?