Post #1223854
2026-04-09 18:51 UTC
@cthos It's not really a "study", exactly, just a blog post where they say these findings are unpublishable because of this issue. They also don't include any of the estimations from the developers about how faster/slower they *think* they were. That, to me, was the much more valuable part of the study.
In this case, if they did try measuring that...
> I found I am actually heavily biased sampling the issues … I avoid issues like AI can finish things in just 2 hours, but I have to spend 20 hours.
This person literally thinks they are 1000% faster with AI. Given the results of the previous study, how close do you think that estimation would be to reality?
Replies (1)
-
@cthos@mastodon.cthos.dev 2026-04-09 18:55
@AndrewRadev anecdotally I keep encountering "it would take me (order of magnitude) longer without the LLM" posts and every time my immediate response is "wait, why would it take you that long?" Like the estimates folks are throwing out do not match my expectations of how long a thing would take me. I dunno if that is hubris / bias on my part but it is wild and I think the "human side" of the estimates for people using LLMs is getting higher.