The chemical reactions and pathways involving pyrimidine deoxynucleoside diphosphate, a compound consisting of a pyrimidine base linked to a deoxyribose sugar esterified with diphosphate on the sugar.