Post #795374
2026-03-27 05:16 UTC
Save this to your permanent reference library: https://ngrok.com/blog/quantization
It's about how large language models store and use numbers, which for the bits I understand is amazing, but what really caught my attention is how different number types are converted to binary. I finally get it!
Found by way of @simon@fedi.simonwillison.net , https://simonwillison.net/2026/Mar/26/quantization-from-the-ground-up/
Replies (0)
No replies.