I mean, there's a reason they don't let you delete system32 anymore

It's like one of the earliest troubleshooting joke memes. It just so happens people actually did that, and not because they wanted to do that.

But like on earlier versions of Windows you could absolutely delete any folder on the drive. I think there's even a story about an uninstaller that accidentally deleted the entire root of the drive because it wasn't written correctly.