Rega P2 setup question

I'm setting up my first real stereo system. On my out of the box Rega, when
I put the counterweight on, the arm moves back slowly across the record to the rest position. Is this normal?
Yes. But you need to adjust the anti-skate and the tracking force according to the manual. Once done, the arm shouldn't move back and forth.
Did that and now the skating is gone. Thanks.
Great. Enjoy.