@kernelpicnic@infosec.exchange
2026-09-25 22:26 UTC
One man's e-waste is another man's datacenter.
Ran 27B model entirely on 11GB VRAM museum piece with 22 tokens/sec and 40k context window.
Model: Ternary Bonsai 2 27B multimodal
- Llama-cpp Prism ML fork
- CUDA 12.9 GTX1080Ti (2017)
- Xeon E5530 CPU (2009) pre AVX
Replies (0)
No replies.