Post #1720315

2026-04-27 13:57 UTC

Looks like another chatbot was allowed to delete production: https://archive.ph/T3LU6 Here is a reminder: If you have something in your environment that executes commands without your permission, what you have is a rootkit.

Replies (1)

@thedoh@hachyderm.io 2026-04-27 14:02

You can say "But we told it not to delete production" all you want, and I feel for you, but people must understand that these chatbots are fundamentally unable to follow their configuration directives 100% of the time. If you want to see this for yourself in lower stakes, configure your chatbot so that it is forbidden from personifying itself/using first person pronouns for itself. They are fundamentally unable to comply 100% of the time because the program being able to ignore its configuration is a feature, not a bug. Understand that the chatbot companies could very easily program them to follow your configuration directives, but like how shitty companies only give you an option to say "Not right now" instead of "never ask me about this again," the chatbot companies win by allowing their chatbots to ignore your configuration.

Open ##1720314