Post #3121846

2026-05-06 11:34 UTC

Not everyone needs a Lamborghini or Concorde to get where they are going. Work is pushing us to use cloud models and I haven't had time to experiment more than a few limited tests. Qwen 3.6 ~30B Q4 runs pretty well on 36GB of ram. It's a very capable model. It did choke when I tried to connect Cline to it for Java dev. But when I just conversationally ask to write python scripts it works pretty well. I can see a future where a goodly amount of ram and an AI chip can produce the results we are currently getting only from cloud models.

Replies (1)

@GamingChairModel@lemmy.world 2026-05-06 15:02

> Not everyone needs a Lamborghini or Concorde to get where they are going. I agree with that. Still, Lamborghinis are still being built, operated, and maintained, while Concordes are not. I'm wondering whether the future of AI looks like the last 50 years of aviation, where there aren't that many generational advances because the cost of developing new stuff becomes prohibitively expensive, but where the commoditization of what has already been invented makes it so that the experience for the average person really isn't that different between 2026 and 1976, where the sweet spot for cost effectiveness isn't at the bleeding edge at all. And for my own curiosity on this line of thinking, I wanted to know whether the day-to-day cost of running these models is going down, and in which contexts.

Open ##3121847