Post #4134131
2026-07-27 09:50 UTC
@troed@swecyb.com Which open model is currently the best allround one? And will I be able to fit anything meaningful onto a 32 gb ram laptop?
Replies (1)
-
@troed@swecyb.com 2026-07-27 09:57
@h4890@merovingian.club It will likely be very slow, but you can fit a Qwen 3.6 35B A3B quant into that memory profile and it's quite useful. I use variants of it for both coding and sysadm-tasks. You'd use llama.cpp to serve it, and try to use as large as possible to fit quant from the ones available here: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF Start with UD-Q4-K_XL and go down smaller Q4s if needed.