It gets below zero in the north east in the winter. Heat pumps stop working at 20-30F and the system has to switch to classic/emergency heat. They are great for fall/spring (or summer as an AC), but useless for winter.
The bigger issue is that it is extremely expensive to install ductwork, wiring for 1 or more thermostats, and a shiny new heating/cooling system in many existing homes that use classic radiator heat. Depending on where the oil tank is located, it may require removal as well (example: if it is underground, depending on state/municipal laws).