The expansion of a mammary stem cell population by cell division. Mammary stem cells are a source of cells for growth of the mammary gland during puberty and gestation. These cells can give rise to both the luminal and myoepithelial cell types of the gland, and can regenerate the entire organ.