Post #3624875
2026-07-06 09:01 UTC
Replies (3)
-
@johncarlosbaez@mathstodon.xyz 2026-07-06 09:12
@marshray@infosec.exchange @petealexharris@mastodon.scot - hmm, now I really want to know why we have that archetype. Given that we have it, it's not so surprising that when we got the ability to make it real, we did. But why were we so interested in all-powerful trickster genies long before we could really create them?
-
@Robotistry@fediscience.org 2026-07-06 11:07
@marshray@infosec.exchange @petealexharris@mastodon.scot @johncarlosbaez@mathstodon.xyz I think it's built into humanity. We are aware of malice because it is a common failure mode in cooperative endeavours, especially in childhood when people have not learned to manage strong emotions like jealousy. Humans develop internal complex predictive models of not only their environment in general but of the behavior of other humans. We default to modeling others at our own level of competence. Which makes modeling toddlers extra hard, because we desperately need to model them, but they are nowhere near our level of competence. Both toddlers and robots often seem "maliciously compliant". They do *precisely* what you ask, especially when that's not what you intended. Of course all humanity has maliciously compliant trickster legends. Anyone with children would love those stories.
-
@ShadSterling@mastodon.social 2026-07-06 13:38
@marshray@infosec.exchange @petealexharris@mastodon.scot @johncarlosbaez@mathstodon.xyz “They’re us” “We’re them”