But they aren’t, they also store all the incorrect solutions. Then, on top of that, they inject randomness into responses to make i non-deterministic, which can cause it to just generate an incorrect solution for no reason. That’s why LLMs can’t do arithmetic.