2026-08-27 01:44 UTC
Hence it should be possible to assign an IQ score to #GenAI. Why hasn't that been done?
Why are the "Generative AI" boosters so shy about running comparisons of their #LLM installations with human beings? Instead they merely run endless "benchmarks" comparing one corporate product to another. That's sufficient to convince the #tech geeks that their machines are constantly getting smarter.
(&c.)
Replies (1)
-
@mxchara@cyberpunk.lol 2026-08-27 01:47
There's a phenomenon here analogous to Elo rating inflation in #chess, a phenomenon which makes direct comparison of Elo ratings between segregated groups (i.e. humans vs. computers, or men vs. women) worthless. If you have a segregated population of players all playing each other, they will inflate each other's ratings relative to how those same players would rate if they were up against the entire chess-playing population. (oop.)