▲ 391 ▼ ChatGPT In Trouble: OpenAI may go bankrupt by 2024, AI bot costs company $700,000 every day (www.firstpost.com) submitted 3 years ago by balfrag@lemmy.world to c/technology@lemmy.world 203 comments fedilink hide all child comments Repost from HN: https://news.ycombinator.com/item?id=37109394
[–] chaogomu@kbin.social 8 points 3 years ago (1 child) The feedback loop is already happening, and is called model collapse. It's not a good thing. permalink fedilink source parent hideshow 2 child comments replies: [–] FaceDeer@kbin.social 3 points 3 years ago The full suggestion includes "This would allow ChatGPT to learn from its own mistakes", which implies that the text it generated would be evaluated and curated before being sent back into it for training. That, as well as including non-AI-generated text along with the AI generated stuff, should stop model collapse. Model collapse is basically inbreeding, with similar causes and similar solutions. A little inbreeding is not inherently bad, indeed it's used frequently when you're trying to breed an organism to have specific desirable characteristics. permalink fedilink source parent
[–] FaceDeer@kbin.social 3 points 3 years ago The full suggestion includes "This would allow ChatGPT to learn from its own mistakes", which implies that the text it generated would be evaluated and curated before being sent back into it for training. That, as well as including non-AI-generated text along with the AI generated stuff, should stop model collapse. Model collapse is basically inbreeding, with similar causes and similar solutions. A little inbreeding is not inherently bad, indeed it's used frequently when you're trying to breed an organism to have specific desirable characteristics. permalink fedilink source parent