Post #988689

2026-04-04 08:45 UTC

Downloading a local LLM to my more than capable Mac Studio to try out running it on device rather than constantly be paying for the cloud. No idea how this will go but it’s a fun project!

Replies (2)

@FreakyFwoof@universeodon.com 2026-04-04 09:13

@stevenscott Been doing this for a few years, it's good fun. A combination of OLlama to run the models and Chi Kim's VOLlama to access them with a nice accessible screen-reader-first interface.

Open ##2128886
@serrebi@serrebiradio.com 2026-04-04 09:43

@stevenscott It's pretty good for being early days, but it's not easy. If you want to really go down the rabbit hole use voLama. I've used perspective cli over the lan to a windows box as well, but it was not! easy! to get up and running with it. It also didn't expose everything it can do just apple foundation chat. I only have 16GB ram so I can't screw around with bigger models, but it feels like really, really early days to me. I'm not giving up on it though. Lots of small tasks it could be used for.

Open ##2128890