Any process that stops, prevents, or reduces the frequency, rate or extent of chromosome segregation, the process in which genetic material, in the form of chromosomes, is organized and then physically separated and apportioned to two or more sets.