Post #2839073

Can an LLM's own pre-solve and post-solve self-assessment signals drive a real test-time control loop? Yes — but only via a per-model SVM trained on labeled correctness, which lifts Sonnet-4.6 from 48.3 to 56.9 pooled accuracy on STEM/code/multimodal. The SVM is precisely the external verifier the "cannot-self-correct" line has argued the loop needs. https://benjaminhan.net/posts/20260522-metacognitive-harness/?utm_source=mastodon&utm_medium=social #Metacognition #Reasoning #LLMs #AI