The process in which neuroblasts acquire specialized structural and/or functional features that characterize the mature cerebellar Golgi cell. Differentiation includes the processes involved in commitment of a neuroblast to a Golgi cell fate. A cerebellar Golgi cell is an inhibitory GABAergic interneuron found in the cerebellar cortex.