Post #2734959

Finally I think I have found a local LLM that works decently with my MCP, Devstral-small-2507. It borks on the odd tool use requests, but it is a very strong model for its size. Quick time to first token too. Now I can really work on figuring out why working with my MCP is so hard for these llms and optimize it some more.