Protect the brand. That's it.

Microsoft doesn't want non-PC stuff being associated with the Bing brand.

It's what a ton of the 'safety' alignment work is about.

This generation of models doesn't pose any actual threat of hostile actions. The "GPT-4 lied and said it was human to try to buy chemical weapons" in the safety paper at release was comical if you read the full transcript.

But they pose a great deal of risk to brand control.

Yet still apparently not enough to run results through additional passes which fixes 99% of all these issues, just at 2-3x the cost.

It's part of why articles like these are ridiculous. It's broadly a solved problem, it's just the cost/benefit of the solution isn't enough to justify it because (a) these issues are low impact and don't really matter for 98% of the audience, and (b) the robust fix is way more costly than the low hanging fruit chatbot applications can justify.