Post #2231592
2026-03-08 14:27 UTC
@RandySimons@mastodon.social @leeg@fosstodon.org I think we have a difference of opinion on how useful the local models that run on inexpensive hardware are, and how the evolution of language models require beefier hardware faster than any other field in software development.
Maybe that will change in the future, and hardware evolution catches up again.
Other than that, I completely agree using a local model avoids the lock-in and rent on LLM subscriptions. That is the model I would personally prefer as well.
Replies (1)
-
@RandySimons@mastodon.social 2026-03-08 14:55
@jani@floss.social @leeg@fosstodon.org I don't know if we differ on that. I use Claude/GPT/Gemini models for work. They *are* way better than qwen3-coder-next, which I've used on my recent hobby project. But it's (already) useful. My bigger concern is that these free models are still too expensive to train by free/libre orgs. We just got some freebies/appetizers from big commercial orgs. If (when?) those dry up, we indeed get to a point were only subscription to proprietary services exist as option.