Any process that modulates the establishment or extent of a membrane potential in a cardiac muscle cell (a cardiomyocyte). A membrane potential is the electric potential existing across any membrane arising from charges in the membrane itself and from the charges present in the media on either side of the membrane.