The directed movement of a dipeptide across a membrane by means of some agent such as a transporter or pore. A dipeptide is a combination of two amino acids linked together by a peptide (-CO-NH-) bond.