Post #3764258

Sometimes they also glue a bunch of “tools” to help the model reason. The model can call by extruding tokens with the right syntax and then get back information from the “tool” shoved in its context! That way, the model can at least handle stuff like basic arithmetic correctly! Except only sometimes, because the models frequently screw up calling the tools correctly or skip using the tool or any number of other completely dumb mistakes. Oh, and if the tool connects the model to the internet (or any insecure source of text) in any way, shape, or form, congratulations, you’ve now got a massive security vulnerability!