Post #3614998

@drwho@masto.hackers.town context is managed a bit more gracefully usually; the LLM is fed the entire context, with one copy of the system prompt, a list of current memories, a list of tools, etc. It's not like your context grows with another copy of the system prompt every time you send an "okay do it" (that would make it go off the rails quickly too), but if the LLM hasn't been touched in a while and isn't cached it might need to re-read the entire context. That said, bad agent frameworks might do it I guess?