I am not a lawyer, but I can't imagine he'll get very far with 'legal' action. It may end up in small claims court.
Save and document all of your interactions with him, just in case.
Save and document all of your interactions with him, just in case.