Post #3325598
2026-06-08 01:53 UTC
I like my local LLM too, but it’s one thing to utilize my existing VRam for a model that fits in there for fault tolerant tasks, and a whole other thing to utilize current frontier models which rack up an energy bill comparable to running a group of space heaters in a building which had to be designed for them, while not even having a guarantee that the output isn’t useless.
Replies (1)
-
@FaceDeer@fedia.io 2026-06-08 02:04
Right, which is why I said 90% and not 100%, and called out the challenge of deciding which tasks to send to which AIs. A lot of the interesting work I'm seeing in AI right now is in the agentic frameworks and harnesses that call the LLMs rather than just the LLMs themselves, these are the things that will break big complicated tasks down into more focused sub-tasks that cheaper LLMs can handle. Given how some of the big providers like Gemini and Anthropic have been cranking up their API costs in recent weeks I expect we'll see a lot more effort being put into rolling those sorts of features out.