This is the weakest of the arguments for trans rights. There's a reason they want everyone to focus on it.
We shouldn't be allowing them to frame the conversation around the one area where identifying as whatever you want actually affects other people.