Interacting selectively and non-covalently with adiponectin, a protein hormone produced by adipose tissue that modulates a number of metabolic processes, including glucose regulation and fatty acid catabolism.