Catalysis of the transfer of xanthine from one side of a membrane to the other. Xanthine (2,6-dihydroxypurine) is a purine formed in the metabolic breakdown of guanine, but is not present in nucleic acids.