@hausfath@fediscience.org the hardware is getting more efficient. But LLMs themselves are only seeing minor gains. To get marginal increases in quality of response, we're needing exponentially more compute power. This analysis only estimates direct energy usage. I've read that if you factor in the energy used for training, and pro rata it to users, it roughly doubles the energy used.