Post #2806289
2026-05-13 18:03 UTC
a few optimizations later and it’s on par with MLX
Replies (1)
-
@flangg@det.social 2026-05-13 18:36
@finnvoorhees@mastodon.social Why is MLX much faster for prefill in the new benchmark?
2026-05-13 18:03 UTC
@finnvoorhees@mastodon.social Why is MLX much faster for prefill in the new benchmark?