Yeah people that make this joke don't pay attention the actual content. Bruce is routinely demonstrated to be a positive force with his wealth. He's socially conscious, generous, invests in progressive causes, runs numerous charities, restricts his company from participating in unethical practices, creates jobs for convicts, and treats his employees very well.
Now, I'm not suggesting this is realistic. No one of Bruce's wealth, in the real world, would be anywhere near as good as Wayne is depicted.
But within the context we of this world, the actual text of the stories tells us quite plainly he is a positive, progressive influence.