Any process in which internalization of an insulin receptor stops, prevents, or reduces the frequency, rate or extent of insulin receptor signal transduction. Internalization of insulin in association with its receptor clears insulin from the circulation and is necessary for subsequent insulin dissociation from the receptor and insulin degradation.