@simplenomad@rigor-mortis.nmrc.org
Post #1625876
2026-04-21 14:45 UTC
Replies (3)
-
@ryanjyoder@techhub.social 2026-04-21 14:53
@simplenomad Talk about flakey tests. 😂 "How did you fix that security warning?" "Oh I just rerun the CI when it fails."
-
@mathaetaes@infosec.exchange 2026-04-21 17:05
@simplenomad the real question is. Is that truly realistic. Without independent, objective evaluation from someone who isn’t already an anthropic fanboy or PR press release, we don’t know what the limitations or tradeoffs are. How many tokens were burned per finding? How much time did it take? How much user interaction is required? I’m also looking forward to being able to do “automated pentesting” as a pre-release step in addition to our own human testing, but the way this was announced and handled thereafter makes it really hard to tell if it’s truly amazing or just cherry-picked cases to hype up the next round of funding and/or an IPO.
-
@Mutesplash@uncontrollablegas.com 2026-04-21 17:18
@simplenomad I imagine that being very expensive and requiring lots of manual intervention.