Any process that decreases the rate, frequency or extent of cGMP-mediated signaling. cGMP-mediated signaling is a series of molecular signals in which a cell uses cyclic GMP to convert an extracellular signal into a response.