240
New report illuminates why OpenAI board said Altman “was not consistently candid” (arstechnica.com)
submitted 2 years ago by to c/technology@lemmy.world
50 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 14 points 2 years ago (4 children)

Okay, so let's do a thought experiment, and take off all the safeguards.

Oops, you made:

  • a bomb design generator
  • an involuntary pornography generator
  • a CP generator

Saying "don't misuse it" isn't enough to stop people misusing it

And that's just with chatgpt - AI isn't just a question and answer machine - I suggest you read about "the paperclip maximiser" as a very good example of how misalignment of general purpose AI can go horribly wrong

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [+] 6 points 2 years ago* (last edited 6 months ago) (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago (1 child)

    None of that is complicated.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 2 years ago (2 children)

    I mean half that is deviant art and you can look up how to make explosives on youtube chem channels or in books. It's not hard to rig up a custom detonator if you can get the energetics.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 0 points 2 years ago (1 child)

    ChatGPT was very far from the first publically available generative AI. It didn't even do images at first.

    Also, there are plenty of YouTube channels which show you how to make all sorts of extremely dangerous explosives already.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    But the concern isn't which was the first generative ai - their "idea" was that AIs - of all types, including generalised - should just be released as-is, with no further safeguards.

    That doesn't consider that OpenAI doesn't only develop text generation AIs. Generalised AI can do horrifying things, even just by accidental misconfiguration (see the paperclip optimiser example).

    But even a GANN like chatGPT can be coerced to generate non-text data with the right prompting.

    Even in that example, one can't just dig up those sorts of videos without, at minimum, leaving a trail. But an unresticted pretrained model can be distributed and run locally, and used without trace to generate any content whatsoever that it's capable of generating.

    And with a generalised AI, the only constraint to the prompt "kill everybody except me" becomes available compute.

  • permalink
  • fedilink
  • source
  • parent