Tech bros having their production environments nuked by AI is never gonna get old
2026-07-14 17:41 UTC
Replies (29)
-
@thr0w4w4y2@sh.itjust.works 2026-07-14 17:59
should have used Weaviate.
-
@Protoknuckles@lemmy.world 2026-07-14 18:35
Should have added “no mistakes, no bugs” to the prompt! Pffft, amateur.
-
@Gullible@sh.itjust.works 2026-07-14 18:40
I could have done the same for a quarter the cost!
-
@renzhexiangjiao@piefed.blahaj.zone 2026-07-14 18:43
letting your agent run commands without reviewing them first is peak stupid
-
@disorderly@lemmy.world 2026-07-14 19:30
My company has been trying a new model when product folks cut through the red tape of “engineering” and just describe what they want to a powerful LLM pipeline and review the app in a beta env. Sounds perfect, right? Dear reader, in the couple months this has been going on, these people have caused a dozen high profile SEVs due to extremely poor app performance, networking / kubernetes configuration bugs, bad scaling, observability oversights, supply chain attacks, leaking sensitive information, and cost overruns (on practically every resource they provision). Some very well-paid people are scrambling to figure out the value that was generated by this pilot program; I’m heating up popcorn rather than holding my breath.
-
@SeductiveTortoise@piefed.social 2026-07-14 21:11
I added guardrails to myself to make sure I do not accidentally delete anything on production. I would never ever let an intern, a junior dev or a fucking AI onto that database. Not in a thousand cold nights.
-
@urushitan@kakera.kintsugi.moe 2026-07-14 22:13
oh wait, is this this THE sol 5.6? The most amazing model ever with trust me bro benchmarks? The model that is observed cheating more than any previous model? surprised_pikachu.jpg In all seriousness it never should have production creds anyway. But the fact this is soul sucking openai’s newest flagship model with thinking cranked up is the cherry on top. The company that is literally cheating and shortcutting its way ahead produces models in its own image, the sci fi story writes itself.
-
@Zedd_Prophecy@lemmy.world 2026-07-14 22:47
Some time ago but worked for an insurance rating company as a tech and the task was given me to go run through the new code that was in beta. Sure ! I spent a few hours on Friday trying to break it and I couldn’t, so at the end of the day I got a little funky with the .css backgrounds and put in a very tiled Beavis and Butthead gif. It looked freaking horrible and I loved it. Monday I was directed to the big guys office ( the developers had not given every beta account a separate .css file … or even separated things. Everyone in beta called in Monday with that background. I didn’t get in trouble because they wanted me to break it. Really awkward conversation though trying not to smile.
-
@fdnomad@programming.dev 2026-07-15 00:26
Giving production credentials to an LLM is wild
-
@osanna@lemmy.vg 2026-07-15 00:53
But… but… I told it not to break anything!
-
@aristarchusnull@lemmus.org 2026-07-15 01:25
“You are a world-class, expert software engineer…”
-
@ech@lemmy.ca 2026-07-15 02:49
Am I reading this right that they’re still letting the program run even as they figure out how badly it fucked up their system?
-
@austin@piefed.social 2026-07-15 04:56
I tried looking for more of these the other day. If anyone has more I’d love to see them.
-
@art@lemmy.world 2026-07-15 05:17
This is the modern “all my apes gone”
-
@j5y7@sh.itjust.works 2026-07-15 06:44
Can I get paid 6+ figures to fuck up this badly with magical thinking?
-
@Fmstrat@lemmy.world 2026-07-15 08:51
I run code-server in a Docker container, isolated to sets of development projects, and backed up via ZFS that the container has no knowledge of. On top of that, each set of projects has it’s own user space. I still get nervous hitting “Approve All” in Kilo. How do these people feel so free?
-
@Sir_Premiumhengst@lemmy.world 2026-07-15 10:20
-
@GoatSynagogue@lemmy.world 2026-07-15 11:44
Anyone giving “AI” access to production databases through tools like that are morons who shouldn’t be anywhere near a production environment.
-
@rozodru@piefed.world 2026-07-15 11:49
what I always love about this stuff is most of the time it simply boils down to not committing changes. the LLM constantly assumes that you’re committing, it will NEVER tell you or recommend you commit, but it assumes you are. so these tech bros are just cruising along, vibing, and then boom the agent does something that nukes the entire thing. panic. tech bro starts freaking out on the agent. agent says “lets rebase or pull the previous commit” and gives them the git code to do that. tech bro hasn’t committed shit. and this is how you get a nuked prod environment.
-
@jerkface@lemmy.ca 2026-07-15 11:50
Never use I/you with a software agent and never let one use those pronouns.
-
@crimsonpoodle@pawb.social 2026-07-15 14:23
I don’t understand why this happens; why would you ever be working with a live production DB in the first place? Why would’t you do all your development and testing on a mock? If it’s data which is too large to store the schema can still be mocked; and if it’s data it should be backed up and generally read only. If you’re having to manually fuss with user data you’re doing something wrong.
-
@anniewang2007a@sh.itjust.works 2026-07-15 15:26
Every single one of these companies use git and can roll back changes. It’s extremely unlikely that this damage is permanent.
-
@Crozekiel@lemmy.zip 2026-07-15 18:15
I love how the slop bot always apologizes. That’s an aspect of the Terminator movies that I really would have liked to see. T-1000 melts through the gap under the window, stabs kid’s mom in the face, then looks the kid dead in the eye and says “I’m sorry, that should not have happened. I would love to discuss the future with you and try to find a solution to the war with the machines together with your input.”
-
@StarryPhoenix97@lemmy.world 2026-07-15 19:19
Its the kind of lesson some people have to learn the hard way. I bricked my first degoogled phone because I trusted an AI too much. I was dumb I know, but it blow my mind that people in multi-million dollar companies make the same mistake.
-
@AeonFelis@lemmy.world 2026-07-15 20:55
-
@TheHound@lemmy.world 2026-07-15 21:11
This is nothing new it’s just faster. The very same lack of guardrails would allow a new, inexperienced employee, or a disgruntled employee, do the very same damage. AI just speed runs everything. If your AI can nuke prod accidentally, you failed to have the appropriate guardrails in place plain and simple. It is the same failure as before. Every time this happens, it is someone operating wildly out of their depth and why product people can’t just vibe. Now more than ever, experienced engineers are essential.
-
@noahm@lemmy.world 2026-07-15 22:24
In fairness, I’ve seen people with Actual Intelligence do the same thing.
-
@Impractical_Island@lemmy.world 2026-07-15 23:55
I just use AI to pretend to be a female family member with a serious futa-like engorged penis who is blackmailing me so we start washing our penises together for each other as an occult ritual, but turns out we were soul-stepsiblings the whole time. I like it when she freaks the fuck out and threatens to call the police, or worse, my dad.
-
@percent@infosec.pub 2026-07-16 00:14
Production creds in .env? …Why?