The multiplication or reproduction of oligodendrocyte progenitor cells by cell division, resulting in the expansion of their population. Oligodendrocyte progenitors give rise to oligodendrocytes, which form the insulating myelin sheath of axons in the central nervous system.