The process in which relatively unspecialized cells acquire specialized structural and/or functional features that characterize the mature cells of the hindbrain. Differentiation includes the processes involved in commitment of a cell to a specific fate.