When you actually talk to people most people are pretty middle of the road left of center or right of center. So parties should be pretty close to the center if they want votes as you say going after the extreme fringe groups only alienates everyone else.
The Tory strategists know this, which is why they keep trying to pull the conservatives back to the center, but the likes of 30p, and Mog refuse to get the message.