It would be equally valid to claim that pubic hair, or menstruation, or any other adult trait is the only one that matters.
This is exactly what you're proposing by claiming that the Tanner Scale is the only determinant. Like really, exactly this. It's beautiful how you're debunking yourself.