Elektrine lite

← Feed

@funkless_eck@sh.itjust.works

At some point AI companies are going to have to charge real money to make a profit from their services. What do you think that amount would be and why?

2026-04-23 12:17 UTC

Replies (18)

  • Copilot Studio is already $30 a month per person, which i think is an insane high price for slop. It’s barely less than the 20 apps you get in Adobe Creative Cloud. Unfortunately, I think the only way people will pay the prices these companies need is if LLMs become so ingrained in our lives that we effectively require them to live (like smartphones).

    Open ##1574387

  • @digdilem@lemmy.ml 2026-04-23 13:06

    It’s about market share (“Your first hit is free…” marketing), but you’re probably seeing only one aspect. They’re already charging very real money for subscription users, especially enterprise. Uber spent $3.4bn, their entire budget for AI fees for 2026, within the first four months of this year - that’s real money by anyone’s definition. We (not Uber) set up a monitoring portal (litellm) to manage this. Some users are burning through a surprising amount, hitting what we considered sane daily limits within their first hour. One person asked a single query that cost $30 . Individual consumers of AI are riding free on this as the big AI players jostle for position and valuation. Will that bubble burst or gradually deflate? Or keep growing longer? Nobody knows, or if they do they’re investing cleverly and keeping their mouth shut.

    Open ##1576041

  • @msrb711@feddit.org 2026-04-23 13:08

    Oh wow, that’s a fascinating topic. This is something I’m looking forward to, because I assume it would be more expensive than we think. I hope to the point where it’s more prudent to pay a skilled worker than XY of money for slop. Currently AI is being indirectly “subsidized” through many high ticket investors, and that besically finances our “slop”. I pray for the day when the AI companies have to “pay the piper” and start charging realistic prices for the use of AI. I am biased because ATM I have to fight tooth and nail to keep my job because my CEO thinks that he can just upload the company logo to AI, and that AI would shit marketing back.

    Open ##1576237

  • @ramble81@lemmy.zip 2026-04-23 13:14

    This is something I keep asking and can’t get a good answer for. You see some of the ads as “your $20 per month gets you $300 in tokens!” But that’s not sustainable unless it’s being subsidized by low use people. But then for that matter, what does the value of a token mean? Is it the amount of money you would save as compared to having a human work? That doesn’t help the company providing the service. Or maybe is supposed to cover the price of the compute to execute the query. That would be ideal, but I don’t think that value is correct. I really think it’s “the first hit is free” approach and soon they’re going to start jacking prices up. I believe all of them are operating as loss leaders, just to try to get market share and even this few initial price increases are showing how much they’re bleeding money.

    Open ##1576484

  • @yogthos@lemmy.ml 2026-04-23 13:39

    I think by the time AI becomes efficient enough to be profitable, it’s going to be efficient enough to run locally and the whole AI as a service business model is going to collapse. We’re basically in the mainframe era of AI right now, and we’ve seen this happen with many technologies before. There’s no reason to think this case will be different.

    Open ##1577578

  • @pyr0ball@reddthat.com 2026-04-23 14:49

    The pricing question assumes the current model (cloud inference, centralized compute, hyperscaler margins) is the only model. Local inference flips that math entirely. If the model runs on your hardware, the marginal cost to the provider is close to zero. The pricing problem is a distribution problem, not a compute problem. What I think actually happens: cloud AI settles at $20-50/month for power users who need the latest frontier models and don’t want to manage hardware. That’s sustainable. The “free tier” disappears or gets severely throttled. But for a large chunk of use cases (summarization, classification, drafting, local assistants) models small enough to run on a consumer GPU are already good enough. That market doesn’t need to pay $50/month to Anthropic. It needs a good local runner and a one-time hardware investment. The companies that will survive the pricing correction are the ones who either have genuinely differentiated frontier capability, or who make local deployment easy enough that users own their own stack.

    Open ##1580819

  • @HubertManne@piefed.social 2026-04-23 14:45

    do they? did search engines? free to play with mmo’s took over the market to some degree. I think there will always be a free tier and a monthly subscription that might get to the level of streaming services and corpo ones that ingest internal data and such and give a variety of professional resources. For that matter might be some professional monthly subscriptions for like coding.

    Open ##1581987

  • @tias@discuss.tchncs.de 2026-04-23 14:51

    Let’s do some estimates: An 8x H100 machine costs about $20 / hr to rent. With a 70B model with 4K context, a H100 node can do about 300 requests in parallel. A single response takes around 30 seconds to generate. An average user sends about 300 messages / month. The throughput of a node is 300 concurrent * (3600 / 30) = 36 000 messages / hour. The cost per message, then, is $20 / 36 000 = $.00055… With 300 messages per month, the compute cost for the AI vendor is 300*$20/36000 = $0.16 / month per user. By contrast, a subscription costs $20. So given these assumptions, it’s other things (like R&D, safety research, training runs, free accounts, etc) that represent the bulk of the cost and those could be scaled down to turn a profit. What will they do? Give how hyped AI is currently and the competitive landscape, I don’t think they’ll increase prices that much. We have products like DeepSeek on the horizon which are much cheaper, so it’s more likely that they squeeze money out of it by becoming more efficient.

    Open ##1582690

  • @hayvan@piefed.world 2026-04-23 16:07

    I expect consumer prices to be always a loss leader, with professional prices starting from €300/month. The image, video, music generators will never be profitable since human artists are also paid jack shit anyway. But they will be available for their marketing value, making the real profit from business use. The business prices need a 10-fold or raise though, at least.

    Open ##1583597

  • @torik@lemmychan.org 2026-04-23 16:27

    I have absolutely no fear that something like chatGPT will always be accessible for free, at least with the functionality we have now with minor improvements. AI is about more than profit; it’s about control.

    Open ##1584239

  • @black_flag@lemmy.dbzer0.com 2026-04-23 18:39

    Read Ed Zitron

    Open ##1589738

  • @Malyca@lemmy.zip 2026-04-23 20:52

    I’m confused, aren’t they already charging? Something about tokens?

    Open ##1596030

  • @mindbleach@sh.itjust.works 2026-04-23 22:32

    They’re fucked. Local models are already winning. Those benchmarked a year behind the biggest of big boys, a year ago. Six months ago they were six months behind. Yesterday Qwen released 3.6 27B and it outperforms 3.5 397B… from February. Either we’re plateauing toward the asymptotic limit of LLM capabilities, and the endgame runs as well on a toaster as it does on a server - or breakthroughs use big fat models as a glorified search space to be rapidly discarded. Both options point toward neural networks as a lump of algebra that sits on your hard drive and occasionally spins your fans. Remote computing loses, as it basically always must, and the drastically reduced requirements for competing on local software favor clever new competitors who aren’t a bajillion dollars in debt.

    Open ##1600998

  • @Lettuceeatlettuce@lemmy.ml 2026-04-24 00:51

    I personally think that general consumers will never use LLMs in any significant number. I think that LLMs will exist in two distinct spaces, FOSS for devs and other technical people who want to run there own infra locally - and B2B for everything else. The few big AI companies that manage to last will be selling access to their models for much higher prices. Probably similar to current proprietary commercial software like VMWare, SolidWorks, VEEAM, Splunk, etc. Companies will pay hundreds, possibly thousands of dollars per seat depending on the niche offering and amount of usage. Suppose that a company developed an LLM that is trained & tuned specifically to do legal work, and suppose it produced work that was around 95% the quality of a typical paralegal. If that company charged $6,000 a year per license to work on their platform, that’s expensive, but if you’re a small firm with say, a dozen full time lawyers, then for the yearly price of a single average paralegal, you could have each lawyer using that software to do most of the work that the paralegal would have done. I can see those kinds of applications happening more and more. This assumes though that LLMs will continue to improve at a significant rate for a long time into the future, (5-10 more years) which isn’t at all obvious, and there is some evidence that it’s already starting to hit a ceiling. There are other ways it might work, like if there is a method of compression that is discovered that reduces the necessary RAM and Compute needs by 2-3 orders of magnitude. So models that are considered very large today (100-300 billion params at full quality) might be able to run effectively on a single 32GB GPU that costs a few thousand dollars. So the cost to run these models is reduced immensely, and a single small data center could run enormous models with 1,000,000+ context windows for tens of thousands of users at once. But that cuts both ways, which is something that any AI company is going to have to deal with. Once small free models get good enough to do the vast majority of a task, a user is going to start weighing the cost/benefits, and the prospect of just buying a box and throwing one of these models in for a few grand will be very appealing. I think there may be a good market out there for “AI boxes”, compact computers designed to run a tuned LLM, set up with a little special sauce so the interface is user-friendly, etc. Companies could sell these with support contracts to legal firms, indie Dev studios, startups, small government agencies, etc. Idk, it’s so up in the air right now, and everything is constantly changing so fast. It’s impossible to predict where things will be in 6 months, let alone 6 years from now.

    Open ##1606736

  • @qaz@lemmy.world 2026-04-25 14:24

    Companies like Claude with their AI subscriptions might be losing money, but I doubt paid-per-token AI API usage is not making them money. There are several companies like e.g. DeepInfra and Fireworks that have sprung up to sell specifically that. I don’t think simply multiplying API cost with expected usage is sufficient however, because I suspect that OpenAI and Claude are making a hefty profit of these tokens.

    Open ##1663591

  • Im not convinced something like Claude isnt profitable with enough users. I dont think people are spending more in compute than they pay. Getting enough paying users though requires it to be better so more people will pay. Obviously the free tier is at a loss, but I mean at a per paid user level.

    Open ##1734412

  • @Karmanopoly@lemmy.world 2026-04-27 00:05

    $1.99 per minute

    Open ##1735951

  • @butsbutts@lemmy.ml 2026-04-24 02:40

    more than the cost of the human labor it replaced

    Open ##1975883