Post #1472684
2026-04-14 06:30 UTC
@markgritter The paper answers the question “how much does the performance of LLMs degrade on esolangs” but that data point by itself is not useful. The more adequate question to ask would have been “*compared to humans*, how much (more) does LLM performance degrade on esolangs”.
Replies (1)
-
@jaseg@chaos.social 2026-04-14 06:35
@markgritter it’s kind of like saying “robot taxis crash into trees 1000x more often when you cover their cameras” without comparing to a baseline benchmark of humans driving with blindfolds.