Post #2248259

@jneen@unstable.systems this is brilliant. I loved this from the ending: """ I think the ultimate fate of AI programming won’t be too far from that of The Last One. When a programming tool is unreliable, completely resists mental-modeling, and is incapbable of consistently rejecting invalid input, I think it’s reasonable to say it’s not fit for purpose, and is certainly not the future of programming. We simply cannot develop mental models of AI through traditional means. But we have to remember that just because we don’t understand it doesn’t mean it’s hiding secret insight or power. """ Have you read of the "Sim City effect" (disclaimer: Noah Wardrip-Fruin was one of my graduate advisors)? It's a nice discussion that extends the "Eliza effect" in several dimensions and seems to match up with a lot of what you're saying here.