Post #4505513

@jcoglan@mastodon.social Uhhh... they did. It's called "KV Caching" All of this is both a subject of active research _and_ the constant factor on that O^2 is basically acceptable, and bounded.