The process in which relatively unspecialized cells acquire specialized structural and/or functional features that characterize the mesangial cells of the kidney as it progresses from its formation to the mature state.