Any process that modulates the frequency, rate or extent of chromatin silencing at the centromere. Chromatin silencing at the centromere is the repression of transcription of centromeric DNA by altering the structure of chromatin.