Post #2176627

@xahteiwi@mastodon.social I've spend 6 (or maybe nearly 9) months trying to get ollama/llama-cpp/vllm working properly with AMD workstation GPUs (W7900). it's been tiring. Model support is hit and miss, stability is not that, and performance doesn't scale. We had to cut our losses (for now) and spend money with nvidia to unblock us... :/ ... would love to revisit this at some point, but right now ... it's like the readme says.