Enables the directed movement of cholesterol into, out of or within a cell, or between cells. Cholesterol is the principal sterol of vertebrates and the precursor of many steroids, including bile acids and steroid hormones.