Post #3910673
2026-07-18 12:42 UTC
I'm REALLY trying to move off of foundational LLM models and would like to run something locally. For the moment, that's just coding. I've heard that Qwen2.5-Coder or CodeGemma are SLMs that are targeted on just coding so are much smaller, and in theory anyone can run on a 16GB Mac.
Has anyone tried this? Are there better alternatives?
Replies (1)
-
@pawel@wspanialy.eu 2026-07-18 12:45
@scottjenson@social.coop Yeah, it's VERY slow. Like literally unusable slow. If you're trying to get off the Claude/Codex train I'd look at GLM/Kimi but it's still subscription. Really good coding agents aren't YET self hostable on "consumer" devices. And if somebody says it's not true they're either lying or have 196GB RAM Mac and are trying to say it's consumer electronic because you can buy it in the store.