Post #1785165

I've predicted for a little while, that the ram price issue combined with the big AI companies either running out of investment capital or deciding to pivot and remove some of their subsidised tiers would result in a few innovations for local LLM development. I'm interested in this. It feels ridiculous running capable dev machines that increasingly have multiple cores, AI co-processors etc and then sending all of your code out to an API somewhere.