Any process that modulates the frequency, rate or extent of mesenchymal cell proliferation. A mesenchymal cell is a cell that normally gives rise to other cells that are organized as three-dimensional masses, rather than sheets.