Any process that modulates the rate, frequency or extent of cell adhesion molecule production. Cell adhesion molecule production is the appearance of a cell adhesion molecule as a result of its biosynthesis or a decrease in its catabolism.