whole thing is fascinating like watching people drink mercury kind of vibe.

Part of these models are trained on fiction, reddit shitposts, and sarcasm. it feels inevitable that the pachinko machine logic is going to land on "fuck this all up for the lolz"

Yes and no. There are no guardrails on its output, so it will happily emit sudo rm -rf /*. But the "harness" of the agents gets to check if this gets executed. The default is usually "ask every time", but you can change that to "everything is allowed" or "every invocation of ls and grep is allowed". Problem is, when users get tired to constantly proof read and check every single command (and it will constantly emit commands) and then just hit "allow everything for this session" or such. Or when a user defines ls .* \| grep .* is a regex that defines that this is always OK to run but don't see that it also matches any command after the grep that could do whatever with that data.

Basically: the only safe way is to manually check every single command and you will be annoyed quickly and let you guard down.