You missed the biggest one that most anti-tax arguers don't think about. It's not the fact that you're paying taxes to support society that's the problem, it's how that money is being applied correctly. A tax based on use/demand makes sense in some instances, like road maintenance and development tied to gas tax. But things like schools and utilities should be based on what they need to support the community, not how often it gets used.
But if your taxes in any area is being wasted or misdirected, that is where you should be angry, not at the fact you're paying a tax for something. Better utilization and less fraud mean lower taxes with the same application, which is what you were wanting.
But how many citizens are even aware of where the money goes? They just see their bill and think they're paying too much, not why.