The multiplication or reproduction of mammary gland branch epithelial cells, resulting in the elongation of the branch. The mammary gland branch differs from the bud in that it is not the initial curved portion of the outgrowth.