An update on my triple 2080ti on DDR3 local solar powered AI server. It's impressive for its age and the fact that I built it for $700 plus a bunch of old crap. Combined forces of older hardware works!
I've got Hermes Agent running, the LLM is Qwen3.6-35B. Hermes has read-only access to my Google Workspace (for good reason!).
The LLM can push 550w+ across the 3x 2080ti GPUs. 33GB of VRAM allows big model and big context - Home Assistant works so nicely with a big LLM.
I want to drop in a Xeon E5-1680 v2 CPU, but that's about it for hardware.
Spec list:
- Intel Core i7-3930K CPU
- Gigabyte GA-X79-UD5 Motherboard
- 64GB DDR3 RAM (8 x 8GB G.Skill Ripjaws X F3-1600C9D-16GXM)
- 3 x NVIDIA GeForce RTX 2080 Ti Blower Edition GPUs (33GB Total VRAM)
- Corsair RM1000e 1000W Power Supply (Refurbished)
- 240GB SATA SSD (OS Boot Drive)
- 3 x 1TB SATA SSDs (AI Storage Array)
- Advantech Industrial Computer 510 Case
#LocalAI, #SelfHosted, #Homelab, #BudgetBuild, #ComfyUI, #HardwareHacking