The process in which a relatively unspecialized cell acquires specialized features of a mesenchymal stem cell. A mesenchymal stem cell is a cell that retains the ability to divide and proliferate throughout life to provide progenitor cells that can differentiate into specialized mesenchymal cells.