#frugalcomputing

6 posts· Last used 4d

The "local LLM" idea doesn't scale.

  • If all LLM users would move to local LLMs, it would make the problem worse because your local compute is never as efficient as that of a specialised data centre. Both hardware utilisation and performance per Watt would be much worse.
  • If the local LLM was really as capable as its cloud variant, the cloud operator would be running the "local" version, and it would do so more energy-efficiently. #FrugalComputing (1/2)
24
1
21
0
Regarding Altman’s claim that humans consume a lot of energy (*): humans' energy consumption is proportional to their wealth, because wealth production requires energy. Wealth is roughly Pareto distributed, which means very few people own most of it and most people own very little: in 2021, 1.1% of the world's population owned 45.8% of world wealth, and is therefore responsible for almost half of the energy consumption and consequently of greenhouse gas emissions. (1/2) #FrugalComputing
49
6
43
0
You've seen all posts