Post #2022543
2026-05-04 06:21 UTC
It's hardly surprising that a model optimized for replacing StackOverflow couldn't survive in the untamed wilderness. As for writing a paper... you must've missed the fact that academia is currently in a crisis precisely because LLMs are better at writing papers than most students.
By the way, the paper the blog post you link to as a source links to as a source benchmarked LLMs on graph diagrams, textile patterns and 3D objects. It is not news that the *language model* would do poorly on visual-heavy tasks.
Replies (1)
-
@thesmokingman@programming.dev 2026-05-04 07:06
Sorry, I assumed you would have actually read [the DELEGATE-52 study](https://arxiv.org/abs/2604.15597) linked instead of just the abstract. For “a model optimized for replacing StackOverflow” that is “better at writing papers than most students” LLMs sure did pretty bad at those tasks over multiple rounds.