Elektrine lite

← Feed

@pojntfx@mastodon.social

Post #3068898

2026-05-15 20:36 UTC

@mitchellh@hachyderm.io I would love to see someone commission a study on this. It _feels_ like things are in general getting less reliable atm, esp. the stack I rely on for work (GitHub, Linear, Slack, Notion, VSCode, ), but then I can't find any data on any of it.

Replies (7)

  • @pojntfx@mastodon.social 2026-05-15 20:38

    @mitchellh@hachyderm.io One of the best descriptions I've heard lately was that it feels like "losing coworkers to dementia" as people adopt it, where everyone feels like they know everything, but when you talk with them in person or there is a problem that needs to be fixed _now_ it becomes very clear that the capability to do that has atrophied basically completely

    Open ##3068899

  • @CppGuy@infosec.space 2026-05-16 15:30

    @pojntfx@mastodon.social @mitchellh@hachyderm.io Agreed. But I think it's worth distinguishing between two aspects of this decrease in reliability: one is the increasing use of #LLMs to write shoddy code that would previously have been written better by humans, but the other is the use of LLMs to find longstanding bugs in code written years ago by humans. The former is a real decrease in reliability; the other is illusory.

    Open ##3068927

  • @hosford42@techhub.social 2026-05-16 16:54

    @pojntfx@mastodon.social I use a different set of tools but I am definitely catching that "vibe" myself. Software quality, in general, is backsliding. And it's not just the frequency of bugs. It's their blatancy. Before, a bug would mercifully show up in some rarely encountered corner case. Now the bugs show up in the main areas of activity. @mitchellh@hachyderm.io

    Open ##3068928

  • @psa@masto.ai 2026-05-17 02:22

    @pojntfx@mastodon.social @mitchellh@hachyderm.io I had read some piece from Github talking about how much extra load they were under due to the percent of commits from LLMs. However, reading through https://github.blog/news-insights/company-news/github-availability-report-april-2026/ shows outages largely driven by logic bugs rather than scaling issues. There's definitely an interesting paper in there somewhere.

    Open ##3068929

  • @RLetot@mamot.fr 2026-05-17 10:00

    @pojntfx@mastodon.social It has been and is studied, some links and conclusions that I recently stumbled upon and might be of interest: https://www.b-list.org/weblog/2026/apr/09/llms/ @mitchellh@hachyderm.io

    Open ##3068930

  • @pojntfx@mastodon.social @mitchellh@hachyderm.io The others I don't know off-hand, but GitHub's outage data just keeps getting gnarlier.

    Open ##3068931

  • @pojntfx@mastodon.social @mitchellh@hachyderm.io Yeah, feel this in my bones. I signed up to Notion just before they went Full AI and the simple and reliable tool I used now feels a little bit more glitchy every day. GitHub has gone downhill in reliability since MS took over it, and that's accelerated as they've gone full-AI. The endlessly memed uptime graph makes this very clear. GitLab seems to have had a not insignificant downshift in quality since they started pushing their AI stack to the point where I'm seriously considering recommending we run our own forge. (Sore point at the moment is a bug I can reproduce in their CI tooling has basically been ignored, and they've pushed several breaking bugs to their CI stack which have caused us a lot of grief.) Atlassian in general, but Jira and Confluence specifically are glitchier every day. (Try selecting rich text with your keyboard) Slack seems to lack that polish it had a couple of years ago. and there's nothing I can point to and say "this is the problem", but these solid, dependable apps seem less solid, less dependable, more glitchy, and more unreliable every day.

    Open ##3068932