Any process that decreases the rate, frequency, or extent of sequestering of zinc ion. Sequestering of zinc ion is the process of binding or confining zinc ions such that they are separated from other components of a biological system.