Post #4372539
2026-08-04 10:32 UTC
@ariadne@social.treehouse.systems @shituationist@kolektiva.social
Whenever someone declares LLMs ded, check which wall they're pointing at, there are three and they keep getting smashed together.
Attached plot: the one people wave around as a ceiling. Log-log axes though, that dashed diagonal is a power law holding over ten orders of magnitude. Chinchilla et.all.
All it prices is compute against loss.
The micro-outage forensics; failed requests, ergo no headroom, ergo scaling is dead, are fun but underdetermined.
Deploys, autoscaler lag and load-shedding all look identical to 'ran out of GPUs' from userland.
Frozen weights don't get tired: capacity pressure fails loudly, not stupid. The honest symptom is the 502. The dishonest one is quiet , quantize harder, trim context, route to the smaller model, same name on the box. Providers do that.sometime
The money, though, sure fair cop. A quarter-trillion vendor backstop should make everyone's eye twitch. HOOOWEVER... (And its not something I wanna argue, still developing this argument)...
A quarterly return is a shit metric for a magic genie that will put all the professionals out of work, forever.
We all know capitalism sucks, and its funny that brologarchs are discovering it too.
Just don't let a shaky business model stand in for a broken scaling law. Power laws have outlived plenty of companies.
TLDR; Yes but no.
Replies (0)
No replies.