The mattress? Like for sleeping?

What's special about 37? Just that it's prime or is there a superstition or pop culture reference I don't know?

Why would that need to be proven? We're the sample data. It's implied.

More than likely it's because of that book and how often it's qouted

Wheres 69 then?

I'm not a hundred percent sure, but afaik it has to do with how random the output of the GPT model will be. At 0 it will always pick the most probable next continuation of a piece of text according to its own prediction. The higher the temperature, the more chance there is for less probable outputs to get picked. So it's most likely to pick 42, but as the temperature increases you see the chance of (according to the model) less likely numbers increase.

This is how temperature works in the softmax function, which is often used in deep learning.

https://youtu.be/wjZofJX0v4M your answer from the 22:00 mark on.

uniform

Reminds me of my previous job where our LLM was grading things too high. The AI "engineer" adjusted the prompt to tell the LLM that the average output should be 3. I had a hard time explaining that wouldn't do anything at all, because all the chats were independent events.

Anyways, I quit that place and the project completely derailed.

I saw that YouTube video as well.

I use the percentile die for that.

Opened up DND Beyond to check since i remember rolling it before and its there, its between D8 and D10, the picture shows 2 dice

Roll two d10, once for each digit, and profit?

This graph actually shows a little more about what's happening with the randomness or "temperature" of the LLM.
It's actually predicting the probability of every word (token) it knows of coming next, all at once.
The temperature then says how random it should be when picking from that list of probable next words. A temperature of 0 means it always picks the most likely next word, which in this case ends up being 42.
As the temperature increases, it gets more random (but you can see it still isn't a perfect random distribution with a higher temperature value)

There's a great Veritasium video recently about this exact thing: https://youtu.be/d6iQrh2TK98

It's a human thing, though. This is just more evidence of LLM's problem with garbage in, garbage out: it's human biases being present in a system that people want to claim doesn't have them.

People do mention Veritasium, though he doesn't give any significant explanation of the phenomenon.

I still wonder about 47. In Veritasium plots, all these numbers provide a peak, but not 47. I recall from my childhood that I indeed used to notice that number everywhere, but idk why.

Veritasium just released a video about people picking 37 when asked to pick a random number.

In a row?!