Post #1334060

Somehow, learning that the guy who tried to firebomb Sam Altman's house is a Yudkowskian disciple is simultaneously unsurprising and yet brings a lot of things into focus I wasn't expecting. It makes sense, but I had to blink twice and go 'oh, of course the guy's one of those folks who treats Paperclips like holy scripture.' (Go, play, it's fun. But don't think it's going to turn real. https://www.decisionproblem.com/paperclips/index2.html ) Ultimately #AI doomerism, at least of the Yudkowskian, Roko's-Basilisk style, is the same thing as AI optimism, just approaching it from the opposite direction. A being capable of building the Torment Nexus must, first, be smart enough to build the Torment Nexus, and that's not about to happen with the present situation. A stochastic parrot the size of the Sun is still not going to be able to reason.