Any process that stops or reduces the rate of a restriction endodeoxyribonuclease activity, the catalysis of endonucleolytic cleavage of DNA in a site-specific manner, resulting in double-strand breaks.