Post #3477433

OK so here’s my evil plan for a junk-box local AI server built from ancient DDR3 era hardware and crap I have laying around. I am stacking three blower RTX 2080 Tis for the 33GB of VRAM (I already have one in hand). I scored an Intel Core i7-3930K and X79 motherboard on eBay for ~$100 bucks and I already have 32GB DDR3 RAM that I'll thief from my old FX8350 rig. A 1000W PSU will power it, I'll power limit the GPUs. This Win10+AMD+Ollama girl will be jumping head first into Linux, Intel, nVidia, GPU stacks, and will run ExLlamaV2 via Oobabooga. For diffusion I am using ComfyUI. Hell I’m even striping junkbox SATA SSDs into a RAID 0 array. Then I'll use NetBird to access my secure solar powered local AI from anywhere. $650 spent; local AI frankenserver coming soon...stay tuned! #LocalAI, #SelfHosted, #Homelab, #BudgetBuild, #ComfyUI, #HardwareHacking