kernelpicnic
kernelpicnic@infosec.exchange
<p>Hardware and IT professional. Cybersecurity, Linux and open source enthusiast. <a href="https://infosec.exchange/tags/tech" class="mention hashtag" rel="tag">#<span>tech</span></a> <a href="https://infosec.exchange/tags/infosec" class="mention hashtag" rel="tag">#<span>infosec</span></a> <a href="https://infosec.exchange/tags/cybersecurity" class="mention hashtag" rel="tag">#<span>cybersecurity</span></a></p>
Posts
-
View post
One man's e-waste is another man's datacenter. Ran 27B model entirely on 11GB VRAM museum piece with 22 tokens/sec and 40k context window. Model: Ternary Bonsai 2 27B multimodal - Llama-cpp Prism ML fork - CUDA 12.9 GTX1080Ti (2017) - Xeon E5530 CPU (2009) pre AVX