Phone numbers are heavily tied to a person.
What signal had going for it is encryption, but that major flaw of tied to phone number makes me doubt everything else they say.
The phone number link means forward security isn't possible. If ever the encryption is hacked, all your messages could be forfeit by anyone who's simply kept the encrypted data.