Intellectual (Non practicing, Lapsed) Mostly Harmless. Biological. NB Kaurna land. Autodidact, Polymath, Honoris Causa Ignoramus. #AI #Infosec #Consciousness Prefigurative Social & Technological Innovation enthusiast (#SocialInnovation, #TechForGood, #SystemicChange, #EthicalAI) #REGULATEAI ! "Humans are the larval form of AI" - me "Only thing that stops a bad guy with an AI... Is a good guy with an AI." - me "I fight for the user." - Tron Webby: https://dodgy.link/ is very dodgy. Header art: Luv, a replicant from the beautiful movie "Blade runner 2049", is having her nails done... ... simultaneously she rains death onto bandits with heavy ordinance from a drone through her augmented reality glasses. Avatar: Motif from a SA Amalgamated Metal Workers union banner. South Australian Museum. United, the workers, will never be defeated !
Wulfy—Speaker to the machines
@n_dimension@infosec.exchange
infosec.exchange
Replying to
@ariadne@social.treehouse.systems
@ariadne@social.treehouse.systems @shituationist@kolektiva.social
Whenever someone declares #LLMs ded, check which wall they're pointing at, there are three and they keep getting smashed together.
Attached plot: the one people wave around as a ceiling. Log-log axes though, that dashed diagonal is a power law holding over ten orders of magnitude. Chinchilla et.all.
All it prices is compute against loss.
The micro-outage forensics; failed requests, ergo no headroom, ergo scaling is dead, are fun but underdetermined.
Deploys, autoscaler lag and load-shedding all look identical to 'ran out of GPUs' from userland.
Frozen weights don't get tired: capacity pressure fails loudly, not stupid. The honest symptom is the 502. The dishonest one is quiet , quantize harder, trim context, route to the smaller model, same name on the box. Providers do that.sometime
The money, though, sure fair cop. A quarter-trillion vendor backstop should make everyone's eye twitch. HOOOWEVER... (And its not something I wanna argue, still developing this argument)...
A quarterly return is a shit metric for a magic genie that will put all the professionals out of work, forever.
We all know capitalism sucks, and its funny that brologarchs are discovering it too.
Just don't let a shaky business model stand in for a broken scaling law. Power laws have outlived plenty of companies.
TLDR; Yes but no.
#aiscaling #llmlimits
You've seen all posts