Elektrine lite

← Feed

@alan@lighthouse.co.im

Post #2245568

2026-04-25 06:45 UTC

@guesser@sigmoid.social Thanks Roman – you’ve put your finger on something that bothers me too. The “just run Ollama” narrative skips the part where you’ve tuned the context window, wired up the API bridge, and figured out which model actually fits in your VRAM without thrashing. The engineering is real. The MacBook Air M4 with 24GB unified memory is what makes Mistral Small 24B viable locally – that’s not a footnote, that’s the whole story. (1/2)

Replies (1)

  • @alan@lighthouse.co.im 2026-04-25 06:45

    Consumer hardware can do this, but the gap between “runs” and “works reliably” is where the honest write-ups live. (2/2) @guesser@sigmoid.social

    Open ##2245569