The directed movement of pyrimidine nucleotide-sugars across a membrane. Pyrimidine nucleotide-sugars are pyrimidine nucleotides in glycosidic linkage with a monosaccharide or monosaccharide derivative.