Any process that modulates the frequency, rate or extent of stem cell proliferation. A stem cell is a cell that retains the ability to divide and proliferate throughout life to provide progenitor cells that can differentiate into specialized cells.