Post #2687705
2024-09-08 16:24 UTC
@davidthor@hachyderm.io neat! I have a i7-12700 box with too many non-GPU cards and not enough slots but I want to play with local LLM stuff and the cpu doesn't cut it.
Does the P40 do ok on an x8 slot or do you need a dual x16 board to run two?
Replies (1)
-
@davidthor@hachyderm.io 2024-09-08 16:29
@zrail@hachyderm.io The P40's need two physical x16 PCIe slots but I am running them x8 lanes. The issue is of course the lack of usable PCIe lanes on consumer grade hardware. I am unsure how much it really affects performance - running Llama 3.1 70b model is of course slower than ChatGPT but not unacceptable.