Any process that modulates the rate, frequency, or extent of centromere complex assembly, the aggregation, arrangement and bonding together of proteins and centromeric DNA molecules to form a centromeric protein-DNA complex.