Post #4242855

2026-07-30 13:42 UTC

RE: https://mastodon.social/@hannorein/116993738619160318 So... after naively asking @hannorein@mastodon.social earlier in the week for advice on someone for the first time asking me for vibe-coding review (because it relates to a paper we're working on that's *almost done*), I've now been asked two more times this week by two different people to provide an "expert scientist" review for AI-vibe-coded output. This future sucks.

Replies (4)

@klausfiend@mstdn.ca 2026-07-30 16:11

@sundogplanets@mastodon.social @hannorein@mastodon.social A lot of the work I see from my colleagues these days is vibe coded. And there's not necessarily anything _wrong_ with it, but it's SO FUCKING LOQUACIOUS and I honestly only have so many hours reading paragraphs of low-density comments in hopes that one of them will be genuinely meaningful. The struggle is real.

Open ##4245663
@masek@infosec.exchange 2026-07-30 16:33

@sundogplanets@mastodon.social Code reviews will probably decrease in importance (depending on use cases). What will gain in importance is reviewing test cases. E.g. What were the test cases at all? Did those include edge cases? What was the coverage? If the use cases were absent or sparse, the code review of AI generated code will yield a predictable result. @isotopp@infosec.exchange wrote quite a bit about that.

Open ##4246231
@sundogplanets@mastodon.social 2026-07-30 14:10

I'll add that I think 2 of the requests were extremely well-intentioned. They just wanted to get an expert to check before sharing widely. I'm sure they didn't think about how much work it would be to actually review their code up to the standards of science (likely impossible). If I think of these as "artist renderings" they're fine, they're just not scientific. (The 3rd request was presented to me with an AI-generated email that used lots of words in creative and incomprehensible ways).

Open ##4253828
@McsaMatt@infosec.exchange 2026-07-31 03:25

@sundogplanets@mastodon.social @hannorein@mastodon.social Invite? No thank you! Pay (an actual salary)? Maybe.

Open ##4263925