Any process that decreases the rate, frequency or extent of high-density lipoprotein particle clearance. High-density lipoprotein particle clearance is the process in which a high-density lipoprotein particle is removed from the blood via receptor-mediated endocytosis and its constituent parts degraded.