Post #1973408
2026-02-26 22:23 UTC
@wolf480pl @leeloo These models aren't intelligent, so much as they're auto-completing rules and patterns derived from almost inconceivably huge corpora of example material originally produced by human intelligence. That's interesting and can be very handy for a great many uses. But it's more computational brute force than intelligence
Replies (1)
-
@wolf480pl@mstdn.io 2026-02-26 22:35
@lmorchard @leeloo These specific models - yes, probably. One plausible argument I heard for it is that there's a common failure mode in ML where the model fails to generalize, but if the verification set overlaps the training set, then data leakage will fool the authors into thinking it generalized. Another one is that these models were "rewarded" for saying plausible things, not for interacting with a world in a way that doesn't get them killed. But these arguments are specific.