Post #2128132

#deepseek V4 Flash should run ok on 2x Strix Halo being around 158GB with 13b active parameters. Looking forward to see their innovations in action, in particular the Hybrid attention architecture for FLOPs and KV cache savings. Plus it‘s only a preview with multi-modality coming later. #localai