Any process that modulates the frequency, rate or extent of the physical partitioning and separation of an epidermal cell into daughter cells. An epidermal cell is any of the cells that make up the epidermis.