The process in which a relatively unspecialized cell acquires the specialized structural and/or functional features of a cardiac fibroblast. A cardiac fibroblast is a connective tissue cell in the heart which secretes an extracellular matrix rich in collagen and other macromolecules.