You mean like construction contractors? Those people either directly or indirectly work for the developers. It's not speculators and landlords being punished people, it's people trying to get housing built, in a housing crisis.
Yes, I know that most of the people running the development industry are dead-eyed reptiles doing it for profit, but still: the shit they're looking to profit from is building homes people live in. Something the government should not be adding extra taxes upon.