Post #3256933

@dajb@social.coop Energy per token != Carbon per token. I don't care if I burn through countless of carbon neutral tokens IE an overnight low run process that runs from energy collated by Solar. I care about the carbon footprint of that energy. Do I care if it's 100x more efficient? Yes. LocalLLMs suck compared to cloud at working on large LLMs at the speed a human needs. If I could make my local LLM 100x more efficient and behave like a cloud provider I'm all ears :) But that's just my opinion :)