The process in which relatively unspecialized cells acquire specialized structural and functional features of a pancreatic epsilon cell. A pancreatic epsilon cell is a cell in the pancreas that secretes ghrelin.