Elektrine lite

← Feed

@kernelpicnic@infosec.exchange

2026-09-25 22:26 UTC

One man's e-waste is another man's datacenter. Ran 27B model entirely on 11GB VRAM museum piece with 22 tokens/sec and 40k context window. Model: Ternary Bonsai 2 27B multimodal - Llama-cpp Prism ML fork - CUDA 12.9 GTX1080Ti (2017) - Xeon E5530 CPU (2009) pre AVX

Replies (0)

No replies.