Post #4036223

2026-07-15 20:14 UTC

Fun fact, it doesn’t actually need your permission. There are no guardrails. It just follows whatever the text it reads tells it to do.

Replies (1)

@elvith@feddit.org 2026-07-16 05:04

Yes and no. There are no guardrails on its output, so it will happily emit sudo rm -rf /*. But the “harness” of the agents gets to check if this gets executed. The default is usually “ask every time”, but you can change that to “everything is allowed” or “every invocation of ls and grep is allowed”. Problem is, when users get tired to constantly proof read and check every single command (and it will constantly emit commands) and then just hit “allow everything for this session” or such. Or when a user defines ls .* \| grep .* is a regex that defines that this is always OK to run but don’t see that it also matches any command after the grep that could do whatever with that data. Basically: the only safe way is to manually check every single command and you will be annoyed quickly and let you guard down.

Open ##4036221