An electric field inside the battery builds up, pointing from the + terminal to the − terminal. This field opposes the motion of H+ ions — they cannot cross to the + terminal, and the reaction stops. When the terminals are connected by a conductor, on the other hand, electrons freely flow to the + terminal.
Just try it, it won’t kill you nor your wallet

