There's a great Veritasium video recently about this exact thing: https://youtu.be/d6iQrh2TK98

It's a human thing, though. This is just more evidence of LLM's problem with garbage in, garbage out: it's human biases being present in a system that people want to claim doesn't have them.

People do mention Veritasium, though he doesn't give any significant explanation of the phenomenon.

I still wonder about 47. In Veritasium plots, all these numbers provide a peak, but not 47. I recall from my childhood that I indeed used to notice that number everywhere, but idk why.

Veritasium just released a video about people picking 37 when asked to pick a random number.