I mean, I understand all that too, but if you have to give that explanation within hours of using the phrase, isn't it maybe an indication that this is a very real risk:

Something to keep in mind so we don’t friendly-fire on our allies!

Also:

The only ones who benefit when you misinterpret things in a way that implies unintended and unsubstantiated bigotry, are those who can use it to reinforce their claims of a misguidedly hypersensitive left, and thereby undermine justified recognition of intended and substantiated bigotry.

I hate to say it, but I don't see much difference between relating the position of the right wing in an attempt to silence someone telling you that your turn of phrase was insensitive and actually holding the right wing position yourself. Do with that info what you will, I'm just calling it like I see it.