Any process that increases the rate, frequency, or extent of brown fat cell differentiation. Brown fat cell differentiation is the process in which a relatively unspecialized cell acquires specialized features of a brown adipocyte, an animal connective tissue cell involved in adaptive thermogenesis. Brown adipocytes contain multiple small droplets of triglycerides and a high number of mitochondria.