← Feed
@cxxvii@aus.social
Post #4307273
2026-07-17 09:26 UTC
@jadehopepunk@hachyderm.io From a criticism standpoint, I would say that the two uses of AI you give, refactoring and builds/installs, don't make sense to me. What I would call refactoring is a very careful task, and anything that is repetitive can and usually has been automated without AI. Same goes for builds/installs, there are all sorts of automated build systems. Specifically what are you automating there?
AI is like a train that works on 90% of its track, and you cannot know in advance where the 10% is going to be. LLMs are trained to produce code that looks correct, so they usually do, but will always sometimes produce code that is wrong in ways an inexperienced developer could only dream of. So every line of AI touched code, even something as innocuous as renamed variables, has to be combed through for errors a human wouldn't know how to make.
Also the deskilling isn't just not getting enough practice, its a consequence of cognitive offloading and the addictive nature of AI, people thinking it helps when it actually doesn't is well documented. There was a study on both junior and senior devs that found they reported being ~20% faster with AI, but were actually ~20% slower, because they were iterating quickly, but doing less. I don't use AI because I know if I actually use it to do anything without doing the amount of extra work you need to do to check, it will change how I think and wear down my critical thinking.
Replies (1)
-
@cxxvii@aus.social yes, I read about that study too. And I have certainly used LLMs (due to workplace mandate) when it involved more "productivity theatre" than actual productivity.
Throughout this year however I've had more and more experiences when it has introduced a step change in productivity on certain tasks. I'm aware that could put me, despite being on the lookout for it, in the category of "thought I was faster, but wasn't".
When I experienced big bursts of what I saw as LLM generated productivity, it unsettled me a lot. If I was certain that AI was bad at refactoring, then I wouldn't need to even face all the other ethical dilemmas.
The more I become certain that it is in fact quite good at it (with various caveats) the more confused and worried I become. To be clear, I'm not trying to convince you to refactor with AI, just giving context for why I'm bothering to try and use it "ethically".
(And to put this in context, I've got 30 years of programming experience, and careful step-by-step refactoring is one of my particular strengths)
Open ##4307276