Post #4039095

@jcoglan@mastodon.social There is prompt caching, although I'm not entirely sure how it works. Basically everyone wants to solve that problem, but it's still easier to manage state by just shoving the whole conversation again down that pipe.