775
Dad demands OpenAI delete ChatGPT’s false claim that he murdered his kids (arstechnica.com)
submitted 1 year ago by to c/technology@lemmy.world
138 comments fedilink hide all child comments
 

A Norwegian man said he was horrified to discover that ChatGPT outputs had falsely accused him of murdering his own children.

According to a complaint filed Thursday by European Union digital rights advocates Noyb, Arve Hjalmar Holmen decided to see what information ChatGPT might provide if a user searched his name. He was shocked when ChatGPT responded with outputs falsely claiming that he was sentenced to 21 years in prison as "a convicted criminal who murdered two of his children and attempted to murder his third son," a Noyb press release said.

you are viewing a single comment's thread
view the rest of the comments
[–] 50 points 1 year ago* (1 child)

Is it really him that it's saying did this? I mean, I could look up my dad's name and all I get are articles about a serial killer who just happened to have the same name; and that's not generated by AI. Names aren't usually unique identifiers.

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 24 points 1 year ago (2 children)

    ChatGPT's "made-up horror story" not only hallucinated events that never happened, but it also mixed "clearly identifiable personal data"—such as the actual number and gender of Holmen's children and the name of his hometown—with the "fake information," Noyb's press release said.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 1 year ago (2 children)

    Humans hallucinate. These things extrapolate tokens statistically. In average his tone of requests would be likely to lead to some murder story.

    Nothing is wrong with the tech (except it doesn't seem very useful when you firmly know what it can't do), but everything is wrong with that tech being called artificial intelligence.

    It's almost like calling polygraph "lies detector".

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 1 year ago

    I replied to the following statement:

    I could look up my dad's name and all I get are articles about a serial killer who just happened to have the same name

    I countered this dismissal by quoting the article, which explains that it was more than just a coincidental name mix up.

    You response is not really relevant to my response, unless you are assuming I'm arguing for one side or the other. I'm just informing someone who dismissed the article's headline using an explanation that demonstrated that they didn't bother to read the article.

    Nothing is wrong with the tech (except it doesn't seem very useful when you firmly know what it can't do), but everything is wrong with that tech being called artificial intelligence.

    If the owners of the technology call it artificial intelligence and hype or sell it as a potential replacement for intelligent human decision making then it should be absolutely be judged on those grounds.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 1 year ago

    I know I've hate the fact that we've settled on the word Hallucinate It anthropomorphizes something that absolutely isn't intelligent.

    It's not capable of thinking a particular piece of information is true when it isn't, because it isn't capable of thinking about information in general.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -2 points 1 year ago (1 child)

    Well, one of is features is remembering details you told it previously. I am surprised it went into child murder territory. In my experience it will usually avoid such topics unless prompted carefully. My initial suspicion is he prompted it into saying these things, but to be fair these things have gone off the rails before. Either way, most people just have a very little or no understanding on what these things are and how they work.

    It's a function approximate...er!

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •