Post #4134130

@h4890@merovingian.club It will likely be very slow, but you can fit a Qwen 3.6 35B A3B quant into that memory profile and it's quite useful. I use variants of it for both coding and sysadm-tasks. You'd use llama.cpp to serve it, and try to use as large as possible to fit quant from the ones available here: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF Start with UD-Q4-K_XL and go down smaller Q4s if needed.