The process in which a relatively unspecialized cell acquires the specialized features of a xanthophore cell. Xanthophores are pigment cells derived from the neural crest. They contain pteridine and/or carotenoid pigments in structures called pterinosomes or xanthosomes. This makes them yellow to orange in appearance.