775
Dad demands OpenAI delete ChatGPT’s false claim that he murdered his kids (arstechnica.com)
submitted 1 year ago by to c/technology@lemmy.world
138 comments fedilink hide all child comments
 

A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as "a convicted criminal who murdered two of his children and attempted to murder his third son," a Noyb press release said.

you are viewing a single comment's thread
view the rest of the comments
[–] 90 points 1 year ago (2 children)

Well, here we are. We skipped using this tech for only search Automation and leapfrogged to directly making shit up (once again).

  • permalink
  • fedilink
  • source
  • hideshow 4 child comments
    •
  • [–] [S] 58 points 1 year ago (3 children)

    To me it's clear that these tools are primarily useful as bullshit generators, and I expect them to hallucinate and be inaccurate. But the companies trying to capitalize on the "AI" bubble are saying that these tools can be useful and accurate. I imagine OpenAI is going to have to invoke the Fox News defense in this case, and claim that "no reasonable person would take this seriously".

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 33 points 1 year ago (1 child)

    Don’t use hallucinate to describe what it is doing, that is humanizing it and making the tech seem more advanced than it is. It is randomly mashing words together without understanding the meaning of any of them

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 10 points 1 year ago (1 child)
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 7 points 1 year ago (2 children)

    The technical term was created to promote the misunderstanding that LLMs "think". The "experts" want people to think LLMs are far more advanced than they actually are. You can add as many tokens to your context as you want - every model is still, fundamentally, a text generator. Humanizing it more than that is naive or deceptive, depending on how much money you have riding on the bubble.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 1 year ago

    I feel like the primary use of these tools is only grammar and writing assistance. Everything else is just plugging in extra tools to make it more useful... although the way Perplexity does it is considerably more useful than the rest.

  • permalink
  • fedilink
  • source
  • parent