546
Google Brain cofounder says Big Tech companies are lying about the risks of AI wiping out humanity because they want to dominate the market (finance.yahoo.com)
submitted 2 years ago by to c/technology@lemmy.world
103 comments fedilink hide all child comments
 
  • Big Tech is lying about some AI risks to shut down competition, a Google Brain cofounder has said.
  • Andrew Ng told The Australian Financial Review that tech leaders hoped to trigger strict regulation.
  • Some large tech companies didn't want to compete with open source, he added.
you are viewing a single comment's thread
view the rest of the comments
[–] 24 points 2 years ago* (4 children)

It won't end the world because AI doesn't work the way that Hollywood portrays it.

No AI has ever been shown to have self agency, if it's not given instructions it'll just sit there. Even a human child would attempt to leave room if left alone in there.

So the real risk is not that and AI will decide to destroy humanity it's that a human will tell the AI to destroy their enemies.

But then you just get back around to mutually assured destruction, if you tell your self redesigning thinking weapon to attack me I'll tell my self redesigning thinking weapon to attack you.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 8 points 2 years ago (1 child)

    I’m an AI researcher at one of the world’s top universities on the topic. While you are correct that no AI has demonstrated self-agency, it doesn’t mean that it won’t imitate such actions.

    These days, when people think AI, they mostly are referring to Language Models as these are what most people will interact with. A language model is trained on a corpus of documents. In the event of Large Language Models like ChatGPT, they are trained on just about any written document in existence. This includes Hollywood scripts and short stories concerning sentient AI.

    If put in the right starting conditions by a user, any language model will start to behave as if it were sentient, imitating the training data from its corpus. This could have serious consequences if not protected against.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 2 years ago

    There are already instances where chat bots demonstrated unintended racism. The monumental goal of creating a general purpose intelligence is now plausible. The hardware has caught up with the ambitions of decades past. Maybe ChatGPT's model has no real hope for sentience, as it's just a word factory, other approaches might. Spiking neural networks for example, on a massive scale, might simulate the human brain to where the network actually ponders its existence.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 5 points 2 years ago (1 child)

    AI doesn't work the way that Hollywood portrays it

    AI does, but we haven't developed AI and have no idea how to. The thing everyone calls AI today is just really good ML.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 2 years ago*

    At some point ML (machine learning) becomes undistinguishable from BL (biological learning).

    Whether there is any actual "intelligence" involved in either, hasn't been proven yet.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 4 points 2 years ago

    Imagine 9-11 with prions. MAD depends on everyone being rational self-interested without a very alien value system. It really only works in the case you got like three governments pointing nukes at each other. It doesn't work if the group doesn't care about tomorrow or thinks that they are going into heaven or is convinced that they can't be killed or any other of the deranged reasons that motivate people to do these types of acts.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 2 years ago*

    The real risk is that humans will use AIs to asses the risk/benefits of starting a war... and an AI will give them the "go ahead" without considering mutually assured destruction from everyone else doing exactly the same.

    It's not that AIs will get super-human, it's that humans will blindly trust limited AIs and exterminate each other.

  • permalink
  • fedilink
  • source
  • parent