Remember, privacy and anonymity are not the same thing. Signal is an app for private communications, not anonymous communications.
You can have privacy without anonymity, and you can have anonymity without privacy, and either/both of those can be secure or insecure.