it will loose its ability to differentiate between there and their and its and it’s.

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 2 years ago (1 child)

Sure it might have some effect, but a big part of ChatGPT besides "raw" training data is RLHF, reinforcement learning from human feedback. Realistically, the bigger problem is training on AI-generated content that might have correct spelling, but hardly makes sense.

  • source
  • hideshow 2 child comments