The multiplication or reproduction of mesenchymal stem cells, resulting in the expansion of a stem cell population. A mesenchymal stem cell, or MSC, is a cell that retains the ability to divide and proliferate throughout life to provide progenitor cells that can differentiate into specialized mesenchymal cells.