Well, the answer, and you imply towards the end, is that it's morally wrong.
If I said...
There are wars currently going on. Slavery, torture, some mass shootings, and every now and then even a genocide happens in the world. So until we stop all that, why shouldn't I go and punch some random person in the face, if it will make me feel better? After all, it's just a drop of water in an ocean of violance.
...you would probably call me an ass, maybe even a lunatic. You'd say I was just looking for excuses to keep being an ass. But that's the thought process you (not just you, more of a general you) are defending and making an excuse for.
The more "utilitarian" answer is that if we can't expect people to make changes in their lives by themselves when they have the choice to, why would we expect them to be okay being forced to make those changes by a government? And why wouldn't they just then go vote for someone who undoes it all?