Yeah, it's certainly problematic, and I'd very much prefer that it not have that dependency. But I think it's still worth using Signal despite needing a number, because it's a really low barrier to getting new users on it.
If you want something truly private w/o the dependency on a number, there are better options, such as SimpleX. However, the barrier to entry there is a bit higher.