The process of regulating the proliferation and elimination of lymphocytes such that the total number of lymphocytes within the mucosal tissue of an organism is stable over time in the absence of an outside stimulus.