The multiplication or reproduction of mammary gland epithelial cells, resulting in the expansion of a cell population. Mammary gland epithelial cells make up the covering of surfaces of the mammary gland. The mammary gland is a large compound sebaceous gland that in female mammals is modified to secrete milk.