I was trying to do a memory test to see how far back 3.5 could recall information from previous prompts, but it really doesn't seem to like making pseudorandom seeds. 😆

you are viewing a single comment's thread
view the rest of the comments
[–] 86 points 2 years ago* (2 children)

I don't know why you would expect a pattern-recognition engine to generate pseudo-random seeds, but the reason OpenAI disliked the prompt is that it caused GPT to start repeating itself, and this might cause it to start printing training data verbatim.

  • source
  • hideshow 4 child comments
  • [–] [S] 22 points 2 years ago*

    Because it literally will. It just clunks out when they get long. The point isn't their randomness, though. The point is for gpt to be able to forget them.

    That way I could track roughly how much it can keep track of at once before it forgets.

  • source
  • parent