Any process that decreases the rate, frequency or extent of ribosome biogenesis. Ribosome biogenesis is the cellular process that results in the biosynthesis of constituent macromolecules, assembly, and arrangement of constituent parts of ribosome subunits.