The "not all men" trope is intended to highlight the unhelpful complicity of that response in the context of patriarchy. It's not meant to imply the inverse, lest you've been walking around supposing that all men are patriarchs. Or similarly, that no cop has ever met their birth father.
Do you think that authoritarianism's hand in ecological destruction means that as humans it is imperative of all of us to overthrow authoritarianism, or do you think it means that all humans are bad and must perish?