Wiki - The paradox of tolerance states that if a society is tolerant without limit, its ability to be tolerant is eventually ceased or destroyed by the intolerant. Karl Popper described it as the seemingly self-contradictory idea that in order to maintain a tolerant society, the society must retain the right to be intolerant of intolerance.
Or perhaps some people aren't fascist when they are angry about the communication problems with refugees, for example . Perhaps they are just simple minded, a bit stupid, politically uninterested, whatever.
These people will always exist. They don't go away when we hate them a lot. Or when we label them as fascist in some kind of Gotcha moment.
A practical solution would be to deal with their problems. Which can easily be done if you are willing to pay a bit of money for community centers etc., which could help with communication and integration tremendously.
It's a mislead interpretation of what tolerance means that makes people wilfully blind to these issues. They will even risk having a party like the AFD growing in seats for this.