Post #2031715
2026-05-05 10:49 UTC
@ariarhythmic @benjaoming Exactly. Now imagine being able to orchestrate those billions of 4GB LLMs. That’s a huge data center, with your users paying the electricity bill.
Replies (1)
-
@kichae@wanderingadventure.party 2026-05-05 12:59
axel. No one wants to use 4GB LLMs, though. Even the 20GB version of Gemma is frustratingly “stupid” and “insubordinate”. A 4GB model is going be impossibly unreliable. There’s no value in using these as a distributed data centre.