Mythos rule
2026-04-23 15:20 UTC
Replies (10)
-
@supersquirrel@sopuli.xyz 2026-04-23 15:35
Data without context is irrelevant and meaningless.
-
@Quacksalber@sh.itjust.works 2026-04-23 15:58
This can be copied 1:1 to right-wingers and wanna-be fascists. They too love to make up scary big numbers.
-
@CriticalMiss@lemmy.world 2026-04-23 16:16
It’s more like the tests we came up with ourselves show our models improved therefore it means you can safely invest a lot of money in us and uhh yeah we will become profitable one day
-
@ActualGrapesTasteGreen@piefed.zip 2026-04-23 15:55
A big detail nobody seems to bring up about Project Glasswing is that they didn’t just prompt it “Hey, check out this codebase looking for issues” and out popped zero days. They ran each project through tens of thousands of dollars worth of compute time. Iteration after iteration and after all that they accumulate a report. Now they’ve reached out to some of the most cash flush companies to say “we can do the same for you.” Put your quarter in the one armed bandit. Maybe you’ll get a zero day but more than likely you’ll get a “better luck next time.” But please, keep paying us. In 10,000 more iterations we’ll surely find the bug that would have cost you millions.
-
@Canadian_Cabinet@lemmy.ca 2026-04-23 16:36
The numbers don’t lie! And they spell disaster for you!
-
@lmr0x61@lemmy.ml 2026-04-23 15:29
As always, the numbers don’t lie — the people do. And worse, we encounter all this with essentially the same brain as the humans who lit the first spark.
-
@Smorty@lemmy.blahaj.zone 2026-04-23 19:39
benchmaxxing and are real annoying. recent local model releases appear to be good, but i dismissed them becuz of the high scores (implying benchmaxxing) this whole project glasswing thing, oh gosh… most of the exploits found by that model were later proven to be findable with older models too, so this is nothing new.
-
@Smorty@lemmy.blahaj.zone 2026-04-23 19:45
on a serious note: designing benchmarks is hard. the consensus has been that creating verifiable benchmarks is surprisingly difficult and the ones that are difficult (like HLE) only get included in these benchmark images when new higher scores are achieved. its just soooo nice seeing a 99% score on a tool calling benchmark which literally just tests for if the model can generate proper json people are trying their best designing benchmarks.
-
@Grandwolf319@sh.itjust.works 2026-04-23 21:35
What is ironic is that there have been consistent reports that it does not improve productivity.
-
@TherapyGary@lemmy.dbzer0.com 2026-04-24 02:59