Post #2057662
2026-05-05 18:51 UTC
@Andy Chrome doing it is so weird to me. Like there is no way them loading a 4gb model into ram is going to be good for their market share.
Replies (1)
-
@Andy@zoner.work 2026-05-05 19:13
@arctic@labyrinth.zone especially for such lame features! I actually like an open source SLM being available for random shit. It can be useful. Quantized Phi 3.5 mini is a little more than 2gb. MoE is like, 4gb. We don't need much more for a small handy little local model.