Catalysis of the transmembrane transfer of a calcium ion by an intermediate voltage-gated channel. An intermediate voltage-gated channel is a channel whose open state is dependent on intermediate voltage across the membrane in which it is embedded.