The process pertaining to the initial formation of the mammary gland from unspecified parts. The process begins with formation of the mammary line and ends when the solid mammary bud invades the primary mammary mesenchyme.