The process in which a relatively unspecialized cell acquires the specialized features of an astrocyte. An astrocyte is the most abundant type of glial cell. Astrocytes provide support for neurons and regulate the environment in which they function.