Post #3556313

One thing I have learned from using smaller local LLMs, if you understand your workflow and what needs to be done well enough and take time to write the engineering docs for it you do not need as large of a model as you think. I get the same results out of my local 26b model for code as I do for Claude Sonnet for code.