Post #3121824

Its easy to think of it similar to something like computer hardware or game consoles. There is always newer and better hardware coming out. And the newer stuff is always more efficient (performance/watt) than the old stuff. But the user's expectations increase as well, so new hardware doesn't just aim to be more efficient, it aims to be more powerful. Then that sets a new baseline for expectations. So a lot of these LLM and other types of models are very much like that. The newer models definitely bring improvements in efficiency and performance. But no one wants to sit still, they have to keep pushing the envelope to make them better and more powerful.