Not using the power doesn't remove it from his grasp. The really rich owner class are oligarchs, even if some of them act benevolently or at least not like the trash they could be.