Basic human rights must be guaranteed. That's what separates us from them. But beyond that? I completely agree, fuck them. Nazis should not have free speech, because Nazis sure as hell won't give you free speech.

It needs to follow a paradox of tolerance situation -- if someone would use X right to get into power so they can take away X from people on the basis of race, religion, sex, orientation, identity, ethnicity, etc then they relinquish X right.

On the surface this seems hypocritical, but it really isn't. Stripping white supremacists and Nazis of free speech is not taking away a right on the basis of race, religion, sex, orientation, identity, nor ethnicity. It's taking it away on the basis that they think a born trait makes someone inherently inferior to them. Believing in discrimination is not a born trait. Plus, there's also the order. The express purpose of limiting the right is to protect vulnerable groups from losing it.