▲ 1292 ▼ Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue (www.tomshardware.com) submitted 3 months ago by throws_lemy@reddthat.com to c/technology@lemmy.world 345 comments fedilink hide all child comments
[–] LadyButterfly@reddthat.com -1 points 3 months ago (1 child) IME it depends which one permalink fedilink source parent hideshow 2 child comments replies: [–] pinball_wizard@lemmy.zip 1 point 3 months ago* (last edited 3 months ago) Just FYI, there are experts in this thread telling you it doesn't depend which one. Yes, some are worse than others. Yes, some have some trivial safeguards added for the worst known risks. But no, none of them are remotely safe for use with self guided therapy. As others have mentioned, anyone doing so would be much better off pirating or shoplifting the appropriate books, directly. Responsible people using AI for expert knowledge always experience risk from the way the AI jumps immediately to the answer it thinks they want, ignoring all other available answers. :( Edit: Sorry, I missed the context you were addressing. Yes! Certainly no one deserves the sucky consequences that can come with these tools just for seeking help! permalink fedilink source parent
[–] pinball_wizard@lemmy.zip 1 point 3 months ago* (last edited 3 months ago) Just FYI, there are experts in this thread telling you it doesn't depend which one. Yes, some are worse than others. Yes, some have some trivial safeguards added for the worst known risks. But no, none of them are remotely safe for use with self guided therapy. As others have mentioned, anyone doing so would be much better off pirating or shoplifting the appropriate books, directly. Responsible people using AI for expert knowledge always experience risk from the way the AI jumps immediately to the answer it thinks they want, ignoring all other available answers. :( Edit: Sorry, I missed the context you were addressing. Yes! Certainly no one deserves the sucky consequences that can come with these tools just for seeking help! permalink fedilink source parent