469
Jailbroken AI Chatbots Can Jailbreak Other Chatbots (www.scientificamerican.com)
submitted 2 years ago by to c/technology@lemmy.world
78 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 130 points 2 years ago* (last edited 2 years ago) (7 children)

dangerous information

What's that?

and offer criminal advice, such as a recipe for napalm

Napalm recipe is forbidden by law? Don't call stuff criminal at random.

Am i the only one worried about freedom of information?

  • permalink
  • fedilink
  • source
  • hideshow 14 child comments
    •
  • [–] 43 points 2 years ago (2 children)

    Anyone remember the anarchist cook book?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 31 points 2 years ago* (1 child)

    Better not look it up on wikipedia. That place has all sorts of things from black powder to nitroglycerin too. Who knows, you could become a chemist if you read too much wikipedia.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 12 points 2 years ago (2 children)

    oh no, you shouldn't know that. back to your favorite consumption of influencers, and please also vote for parties that open up your browsing history to a selection of network companies 😳

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 6 points 2 years ago (2 children)

    Info hazards are going to be more common place with this kind of technology. At the core of the problem is the ease of access of dangerous information. For example a lot of chat bots will confidently get things wrong. Combine that easy directions to make something like napalm or meth then we get dangerous things that could be incorrectly made. (Granted napalm or meth isn’t that hard to make)

    As to what makes it dangerous information, it’s unearned. A chemistry student can make drugs, bombs, etc. but they learn/earn that information (and ideally the discipline) to use it. Kind of like in the US we are having more and more mass shootings due to ease of access of firearms. Restrictions on information or firearms aren’t going to solve the problems that cause them but it does make it (a little) harder.

    At least that’s my understanding of it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 2 years ago (1 child)

    I don't exactly agree with the "earned" part but guess you have a point with the missing 'how to safely handle'.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 years ago*

    By earned I mean it takes some efforts to gain that knowledge. For example some kind of training, studying, practice, etc. it’s typically during that process you learn how to safely and correctly do things

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 2 years ago* (last edited 2 years ago) (2 children)

    John Halo won the Olympics for America

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    Fill a supersoaker with it and turn a fun day at the Waterpark in a fun human barbecue.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 2 years ago (2 children)

    Would not the super soaker and the person holding it melt way faster than anything else ?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [+] -46 points 2 years ago (13 children)

    What possible legitimate reason is there for needing a napalm recipe?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 26 child comments
    •
  • [–] 45 points 2 years ago (2 children)

    I can't think of a single reason knowledge should be forbidden.

    Sure, someone could use knowledge to do bad things, but that is true literally every second of every day, in completely above board, legal, broad daylight bad things.

    It's nitpicking.

    Besides, I can think of quite a few legitimate reasons one might need napalm, explosives, homemade firearms, chemistry lab setups and spore cultures and much much more.

    A lot of people seem to forget that their own view of their own government doesn't mean the same things are true for someone else and their government.

    I'm sure a lot of people in EU countries might have asked themselves the same thing 80 years ago. You know.... If napalm were around then anyway.

    Good thing molotovs are easy and can be assembly-line'd.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 7 points 2 years ago

    A lot of people seem to forget that their own view of their own government doesn't mean the same things are true for someone else and their government.

    It also doesn't mean it'll be true for their own government in the future. Violence sucks, but it isn't always bad. People should be allowed to learn these thing just for the fun of it if they want. Hopefully the time never comes where they need to be practically applied (besides the situations you gave and others like them) but if it does the knowledge will hopefully be available.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 28 points 2 years ago (1 child)

    Fiction author determining where their character may get components for the napalm.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 2 years ago (1 child)

    Gas station and gardening center, plus a specific material used in packaging.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 24 points 2 years ago

    Writing a book or screen play, knowing how NOT to create napalm, recognizing when napalm is being created by others, Intellectual curiosity, To better understand military history, overthrowing fascism, fighting terminators, etc. etc.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 14 points 2 years ago (1 child)

    How to make sure I'm not making it by accident? That is the reason why I have a general understanding of atomic bombs

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 14 points 2 years ago (1 child)

    I'm sure there are some, but it doesn't really matter because the recipe is publicly available right now on the internet. So if an AI chatbot can give you the information it's not particularly a concern.

    It's not actually hard to make.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 6 points 2 years ago

    What possible legitimate reason could someone need to know how to make chlorine/mustard gas?

    Apart from the fact that they are made from common household products, are easy to make by mistake, and can kill you.

    Wait that’s true of napalm as well… fuck.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 5 points 2 years ago (2 children)

    Fun

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 9 points 2 years ago (2 children)

    Uh, wait, the jelly i once made in my dads workshop by dissolving styrofoam in gasoline, was already a napalm substitute?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 14 points 2 years ago

    So I have no other reason for sharing this than "napalm substitute" and I never get to talk about it.

    My dad and his brothers dumped a bunch of packing peanuts into gasoline to make the soup, got a bunch of tennis balls, and DROVE A CAR (junker, but still) onto a frozen lake, with lighters and candles, a small bucket of gasoline and a bucket of water.

    The plan was for one of them to drive around sliding all over the ice while the others dunked a ball into the soup, light it, and throw it at the car.

    Now you might wonder why they did the napalm substitute.

    Because THEY ALREADY FUCKING TRIED THIS with regular gasoline, and quickly found out gasoline soaked tennis balls splash when thrown. Specifically onto their backs. While burning. I've seen burn scars on at least two of his brothers from the shit they did as teenagers.

    So the napalm was a bit more grippy to the balls. But still not enough.

    Apparently they never figured out how to "safely" do it, but boy that sure didn't stop them from doing this several years in a row.

    I saw his lake frozen over ONCE when I was a child. Nowadays it barely gets ice around the shoreline.

    I don't think they ever had a plan for if the car actually caught on fire, my guess is "let it burn into the ice, sink, and forget about it"

  • permalink
  • fedilink
  • source
  • parent