Post #1926514

@tshirtman @fvsch Using cloud LLMs like always-on, autonomous agents gets expensive. While they've gotten better at following instructions compared to before, you can't say they're cost-effective by any means. And if you try to do the same thing with local LLMs, they demand 128GB or more of VRAM. Otherwise, they can't even use their full context window and just get stuck in a loop of small failures. In short, it's just a toy for people with six-figure salaries.