Post #1726502
2026-04-16 18:30 UTC
@lexoyo the quantized open weights models that will run fantastic on a 2080 Super are becoming compelling...
Replies (1)
-
@lexoyo@framapiaf.org 2026-04-16 22:35
@km6ecc hey thx for the pointer, I am experimenting with local models too :) On my setup it's almost usable but not quite, I'll keep trying My question about hosted options ia for a company I have been talking to, they are about to go full anthropic soon. I'd like to avoid that for them to have the option later to be more responsible and use smaller LLMs depending on the task