Any process that decreases the frequency, rate or extent of centrosome duplication. Centrosome duplication is the replication of a centrosome, a structure comprised of a pair of centrioles and peri-centriolar material from which a microtubule spindle apparatus is organized.