Post #3387474

2026-06-20 15:24 UTC

@sherbang@chaos.social @Hex@kolektiva.social @orange_lux@eldritch.cafe @saxnot@chaos.social @dibi58@this.mouse.rocks I work at a cloud provider and can confirm that running ai isn't as cheap as it sounds. My take is that most models are so general purpose that they're very inefficient (versatile, yes, but inefficient). Think "sorting an array through a bogo sort" inefficient. LLMs trained for a specific purpose may be more cost-effective to run long term, but that's not the norm.

Replies (1)

@Hex@kolektiva.social 2026-06-20 16:10

@karl@infosec.exchange @sherbang@chaos.social @orange_lux@eldritch.cafe @saxnot@chaos.social @dibi58@this.mouse.rocks I know how much it takes to run at least basic models because I'm running local models for experiments. I won't use hosted models because I'm not giving them money or training data. But yeah, capitalists are trying to sell something that doesn't exist and that they don't understand. I would be entirely unsurprised to find out that even inference on corporate models can't cover costs. To sell "AI" it has to be a thing that just works for everything all the time. It must take no thought. That's incredibly wasteful. It needs to stop being subsidized, just like cars.

Open ##3387475