Interacting selectively and non-covalently with an insulin-like growth factor, any member of a group of polypeptides that are structurally homologous to insulin and share many of its biological activities, but are immunologically distinct from it.