Post #1988893
2026-04-20 20:39 UTC
@IAmDannyBoling @ManyRoads yes, to my understanding, if you install an open model on your machine and restrict access to only specific folders and files, for example in opencode, this can be done. The question is if those less powerful models will give you the results you’re looking for. And you might either need one of the latest Macs or a really powerful GPU and a good amount of RAM to run the better models reliably.
https://www.canirun.ai
Replies (2)
-
@ManyRoads@mstdn.social 2026-04-20 20:46
@matthiasott @IAmDannyBoling I agree for those who require intense programming or scientific work, small language models or quantized LLMs may not function 'fully', But for mere mortals, a good slm can provide a 90% solution with much improved security.
-
@Luna@mastodon.world 2026-04-20 22:48
@matthiasott @IAmDannyBoling @ManyRoads I ran a couple on Geforce 3x00 cards.