Catalysis of the transmembrane transfer of a potassium ion by a voltage-gated channel through the plasma membrane of a cardiac muscle cell contributing to the repolarization phase of an action potential. A voltage-gated channel is a channel whose open state is dependent on the voltage across the membrane in which it is embedded.