Post #2057664
2026-05-05 19:13 UTC
@arctic@labyrinth.zone especially for such lame features! I actually like an open source SLM being available for random shit. It can be useful. Quantized Phi 3.5 mini is a little more than 2gb. MoE is like, 4gb. We don't need much more for a small handy little local model.
Replies (0)
No replies.