Well that comes back to things like gerrymandering, first past the post, non-preferential voting, no mandatory voting.

You get what you vote for, if the people who want what you want don't vote then don't complain that those who did vote got what they voted for.