Elektrine lite

← Feed

@fonix232@fedia.io

2026-10-15 06:40 UTC

They CAN be made more efficient. Hell, AMD just bought a company that translated LLMs to direct silicon... which should enable scalability if it wasn't for one of the key players owning the tech thus limiting its use. It's also estimated that some 70% of Claude tokens gets spent on recursive self-correction so the output is higher quality. Instead of bettering the model, Anthropic just keeps throwing money at it to make the problem go away. Meanwhile Chinese models - as small as 36-40-80b params - are outdoing these fancy frontier models if the right harness is used.

Replies (3)

  • @FaceDeer@fedia.io 2026-10-15 06:55

    I've spent the last month or so using nothing but a local 27B Qwen model as my coding assistant and it's working fine. The big American AI companies could all collapse in ruins tomorrow and it's not going to slow things down all that much, anyone who wants to use AI will be able to continue using it. Might even be better in the long run if that happens - the people who are scared of ASI will get their much-demanded temporary slowdown at the frontier while everyone else catches up with open-weight models that everyone can use without central control. Pity about the economy in the meantime, I guess.

    Open ##5204569

  • @maegul@lemmy.ml 2026-10-15 07:08

    If you’re talking about the company I think you are, that acquisition by AMD is interesting news. The company was the one with a demo AI in their page that was super quick?? I always figured that was the future of AI when I saw it. Where you’d buy processors with n number of “AI cores” that’d have work/prompts scheduled as needed in the same way we now CPUs and RAM.

    Open ##5205243

  • @chunes@lemmy.world 2026-10-15 08:22

    Is anyone trying to make LLMs with memristors? That would make them absurdly efficient

    Open ##5207244