Post #3121837
2026-05-06 14:31 UTC
1. The cost of hardware has always gone down. If it seems different in the last few years, that's because demand has gone up and people are outbidding each other to get the same scarce resource. But the fundamentals have not changed. Once Production catches up, prices will return to the previous trajectory.
2. Going down. At the same size, models are more capable. This is both because training data is being incrementally refined, and because better methods are thought up.
3. Going up. Bigger models are better, but more expensive to run. They also require more data to train. The trend towards bigger models will continue for the foreseeable future. How quickly models can be scaled up is limited by the logistics (data centers and training data)
Replies (1)
-
@GamingChairModel@lemmy.world 2026-05-06 18:33
> The cost of hardware has always gone down Seems like performance per unit cost necessarily has to spread between performance per dollar that the actual computer hardware costs and performance per watt-hour of ongoing energy consumption. Obviously each generation of chips shows exponential growth in performance, but how much is that advancement offset by increased power consumption and increased price of the chip itself? That's what I mean. I'm interested in seeing actual numbers, like seeing how costs differ in specific model/hardware combinations, with certain assumptions on the price of electricity and maybe interest rates or amortization schedules.