it will loose its ability to differentiate between there and their and its and it’s.

you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 2 years ago (2 children)

ChatGPT was already trained on Reddit data. Check this video to see how one reddit username caused bugs on it: https://youtu.be/WO2X3oZEJOA?si=maWhUpJRf0ZSF_1T

  • source
  • hideshow 4 child comments
  • [–] 3 points 2 years ago (1 child)

    I'm not gonna watch, but I assume little Bobby Tables strikes again.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 years ago

    It's about the counting subreddit. It was used on the token generation database, but then removed on the training. This user posted so much on that subreddit that a token with its username was created, but then it had nothing associated with it in the training and the model dosen't know how to act when the token is present.

  • source
  • parent