Interacting with an activin receptor complex to reduce the action of another ligand, the agonist. A receptor antagonist does not initiate signaling upon binding to a receptor, but instead blocks an agonist from binding to the receptor.