The aggregation, arrangement and bonding together of a set of components to form an asexual spore wall, the specialized envelope lying outside the cell membrane of a spore derived from a product of mitosis. Examples of this process are found in Bacterial and Fungal species.