The increase in size or mass of an inflorescence meristem, a population of undifferentiated cells in a plant shoot which produces small leaves and then floral meristems, which will give rise to flowers.