Any process that stops, prevents, or reduces the frequency, rate or extent of ubiquitin ligase activity, the catalysis of the reaction: ATP + ubiquitin + protein lysine = AMP + diphosphate + protein N-ubiquityllysine.