Post #2806288

Using these + swift-huggingface + swift-transformers I put together a POC Gemma 4 inference engine that is honestly not far off from MLX, which is nice given it has pretty much no optimizations or fused kernels (MLX seems to have massive prefill overhead) https://github.com/finnvoor/Popcorn/tree/main/Examples/GemmaCLI