Because libel and slander are targeted at individuals. Groups and worldviews do not enjoy the same protections as individuals by most law systems. That's mostly a good thing.

I have no love for the right-wing nutjobs trying to incite intercultural violence but at the same time I don't think what they're doing can be made illegal in a liberal society.