The process whose specific outcome is the progression of the rectal diverticulum over time, from its formation to the mature structure. The rectal diverticulum is an outgrowth of the cloaca and links the pronephric kidney to the exterior.