Any process that decreases the rate, frequency or extent of mitochondrial fission. Mitochondrial fission is the division of a mitochondrion within a cell to form two or more separate mitochondrial compartments.