Post #1286704

@wren6991 Hmm I've had good luck with MoE - especially since I'm running on CPU; just been playing with the Gemma 4 MoE version (26B-A4B - the unsloth quantised version) and it seems to me the smartest I've run locally and relatively fast.