Mike Watson 🇨🇦
@mamba@mstdn.ca
Senior Director, Integrated Systems & Tech for a national non profit 🇨🇦 Optimistic about AI in the NFO and NGO space, pragmatic skeptic of AI hype. Championing Integrated Stacks, Privacy and Data Ethics in the NFP sector. Occasional amateur photographer.
mstdn.ca
Tool calling quality is noisy in a way LLM text generation isn't. The difference between "works" and "explodes" is tiny, and traditional benchmarks miss it. We need tool-specific evaluation frameworks. It would almost immediately become one of the most sought-after metrics.
#AgenticAI #ToolCalling #LLM #MLevaluation #AIinfra #machineLearning #hermesAgent #openclaw #claudecode