1292
Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue (www.tomshardware.com)
submitted 3 months ago by to c/technology@lemmy.world
345 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] -4 points 3 months ago (2 children)

I don't see how nothing would be better someone using a good quality AI to for example, ground them during a panic attack.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 5 points 3 months ago (1 child)

    AI will not ground you, it will reinforce what you already believe. that's why it's very dangerous for "therapeutic" use.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] -1 points 3 months ago (1 child)

    IME it depends which one

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 months ago* (last edited 3 months ago)

    Just FYI, there are experts in this thread telling you it doesn't depend which one.

    Yes, some are worse than others. Yes, some have some trivial safeguards added for the worst known risks.

    But no, none of them are remotely safe for use with self guided therapy.

    As others have mentioned, anyone doing so would be much better off pirating or shoplifting the appropriate books, directly.

    Responsible people using AI for expert knowledge always experience risk from the way the AI jumps immediately to the answer it thinks they want, ignoring all other available answers. :(

    Edit: Sorry, I missed the context you were addressing. Yes! Certainly no one deserves the sucky consequences that can come with these tools just for seeking help!

  • permalink
  • fedilink
  • source
  • parent
  • [–] 4 points 3 months ago (1 child)

    Because nothing doesn't run the risk of encouraging catastrophizing, acting on your heightened emotions, or coming to irrational conclusions. If it's consistently able to not do those things for a variety of people that's great. But as someone who had to learn to control her panic attacks, I absolutely can see advice and recommendations that are worse than nothing.

    And yeah given llms' reputation for dealing with psychosis, delusions, and suicidality, I don't trust any of the technology compared to nothing, despite knowing how difficult nothing is for panic attacks.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 months ago (1 child)

    IME it depends which one

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 3 months ago (1 child)

    That's fair, but given the way the technology actually works, I stand by my position that there is a very real potential for harm and safer alternatives that are similarly accessible. If studies show it's safe and helpful that's cool, but at this moment I'd strongly discourage any loved one who's interested in using an llm for this purpose and would instead point them towards other resources.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •