Post by @gerikson@awful.systems

2026-10-05 12:49 UTC

More disucssion about AI safety over at LGM www.lawyersgunsmoneyblog.com/2026/10/ai-safety comments are a mix, some smart generalists incorrecting each other. I have not bothered to comment because I’m not an active part of the community, but I’ll share here that Rofer’s recommendations about safety we can apply now would presumably help us contain Robot Satan should it deign to be created. Lots of commenters don’t really draw that conclusion. This is pointing out the yawning void between the intense interest among Rats to devise the perfect alignment and their disinterest at mitigating harms ocurring right now.

Replies (1)

@sinedpick@awful.systems 2026-10-05 13:56

With the agents pouring concrete, we can now focus on the thing as a whole. This is such a dumb take because it’s wrong in both directions. Either LLMs are really bad and shouldn’t be trusted to write code and by trusting them you’re going to utterly fail. Or LLMs are actually good enough to write code, but then they’ll also be good enough to design/architect anything you could and reduce your labor’s value to zero (e.g. someone will create a harness that lets the business guys TRULY prompt whatever they want into existence). The only situation where this works out for labor is if LLMs end up frozen in some middle ground where they don’t get any more capable. This idea that the LLM is analogous to a camera is such an insipid, thought-terminating cliché.

Open ##4934577