Post #2687707
2024-09-08 16:40 UTC
@davidthor@hachyderm.io for sure. I have seen some builds (not for LLM) that go back a gen or two and use used Epyc boards off of eBay specifically for the PCIe lane overkill.
Replies (1)
-
@davidthor@hachyderm.io 2024-09-08 17:32
@zrail@hachyderm.io Yep, a good way forward I would think, maybe in a future iteration? I did this one on the cheap, had most of the components lying around. A poor man's LLM rig if you will! If I find myself running services using this machine that I don't want to be without then I might do some upgrades.