The process in which a relatively unspecialized cell acquires specialized features of a glycogen cell of the placenta. A glycogen cell is a vacuolated glycogen-rich cell that appears in compact cell islets of the spongiotrophoblast layer.