For some reason, Elder Scrolls is cursed. EVERY Elder Scrolls game that comes out (except Daggerfall) has a massive number of detractors about some facet of it that is "a pale shadow" of the previous.
I was around when people treated Morrowind like they are treating Starfield now. Then Oblivion had a much smaller complaint-base, but it revolved around the "disappointing lack of immersion" because Morrowind was such an opinionated game. Then Skyrim comes out and "it's like they put Training Wheels on Oblivion".
Starfield is just suffering from the same Elder Scrolls curse (but in space). To me, Starfield is a great game that might not be for everyone, but that some of those walking away from it are being told they don't like it.
And it's a bit of a problem. There's not much to change. The story is deep, so they can't add more story like NMS did. It's the most stable Bethesda game ever, so it's not about building stability. The gameplay mechanics are reasonable, so it's not about adding new systems. Bethesda might well be screwed this time - because there's nothing to change.