Any process that modulates the frequency, rate or extent of action potential creation, propagation or termination in an atrial cardiac muscle cell contributing to the regulation of its contraction. An action potential is a spike of membrane depolarization and repolarization that travels along the membrane of a cell.