Post #1726504
2026-04-16 22:35 UTC
@km6ecc hey thx for the pointer, I am experimenting with local models too :)
On my setup it's almost usable but not quite, I'll keep trying
My question about hosted options ia for a company I have been talking to, they are about to go full anthropic soon. I'd like to avoid that for them to have the option later to be more responsible and use smaller LLMs depending on the task
Replies (1)
-
@km6ecc@mastodon.radio 2026-04-17 20:25
@lexoyo I could not tell you about frontier or subscription models! I'm just very impressed with how much improvement there is in models that run locally. It think the edge and potato compute is really improving on a curve faster than the frontier... There is some evidence of that. But clearly the subscription models are, impressive and have more compute behind them so... It is not all curve.