If your method of investing in housing is just buying and selling the same house, then yes it’s not going to work. That’s also a good thing because someone who just buys low and sells high isn’t producing any value.
But people can invest in properties by improving them before selling, and also by renting them out. And neither of those situations requires a housing market whose average price is outpacing inflation. In those situations, it’s the production of actual value that is the source of the profit.
Profiting from arbitrage requires a fucked up market, and a lack of information. Profiting from producing value just requires clear communication and competency. Two very different kinds of profit seeking.