Any process that stops, prevents, or reduces the frequency, rate or extent of action potential creation, propagation or termination. An action potential is a spike of membrane depolarization and repolarization that travels along the membrane of a cell.