I can see someone in the future watching a program run and asking "wow, is that ai? A PERSON typed those cryptic letters? No way!"

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 11 months ago (1 child)

Yes, that's why it's necessary for it to be non-deterministic. Without non-determinism, there is no error recovery if it chooses the wrong token somewhere in the middle of the completion. That's much less useful.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 11 months ago (1 child)

    What's this error recovery business you speak of?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 11 months ago*

    So you can try your prompt again. Also to avoid getting stuck in loops of repeated text. Getting stuck down a bad line of "reasoning". Etc.

    Low chance of error comes with low chance of error recovery, conversely high chance of error comes with high error recovery ability (mostly just talking about temperature and top k, here)

  • source
  • parent