you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago*

The model ISN'T outputing the letters individually, binary models (as I mentioned) do; not transformers.

The model output is more like Strawberry

Tokens can be a letter, part of a word, any single lexeme, any word, or even multiple words ("let be")

Okay I did a shit job demonstrating the time axis. The model doesn't know the underlying letters of the previous tokens and this processes is going forward in time

  • source
  • parent