Elektrine
Log in Register

#localllm

9 posts · Last used 20d

Back to Timeline
crankylinuxuser
Yet another Josh :donor: @crankylinuxuser@infosec.exchange · Jul 25, 2026
Replying to @RnDanger@infosec.exchange
@RnDanger@infosec.exchange There's so many problems with these claims. Banning generated code? How do you even tell? Code quality? 'Claude' committed it? Has a certain "smell"? Or is it the US supreme court obscenity standard of " I'll know it when I see it."? Cause that last one is what Codeberg admins said they'd use. For obvious reasons, this is a terrible precedent. As for environmental impact, everyone who howls about that ignores that you can run #localllm on your own machines. And with Chinese open source/weight models freely available, means I can own my means of computation. And Chinese energy is some of the most environmentally sound given TW's of their energy is solar, and rewilding the edge of the Gobi while they're at it. I guess it does use a mug of water an hour.... Cause I'm drinking that mug of coffee. And 'submitting slop to the stack', so most FLOSS projects are just 1 human. So 1 human+1 bot is now somehow troubling?? I reject that assessment. The bot could be doing test writing, documentation, validating specifications, attacking the code in a container, etc. Now the big projects that are inundated - there are simple ways to impede that. Account age. Minimum viable commits. Required tests. Proofs of concept. No refactoring. Most of those would block the deluge.
0
1
0
crankylinuxuser
Yet another Josh :donor: @crankylinuxuser@infosec.exchange · Jul 22, 2026
Replying to @ainmosni@social.ainmosni.eu
@ainmosni@social.ainmosni.eu @ErikJonker@mastodon.social Running #LocalLLM IS seizing the means of production. The american LLMs aren't sharing, but the Chinese are sharing. Guess what models I run?
0
0
0
crankylinuxuser
Yet another Josh :donor: @crankylinuxuser@infosec.exchange · Jul 02, 2026
UPDATED, pinged the problem children. @mozilla@mastodon.social @thunderbird@mastodon.online Sigh. I was hoping that #Thundermail #Mozilla #email would be good. NOOOOOOOPE. I had my #localLLM review their Terms of Service #TOS and #PrivacyPolicy . Its general Big Tech nonsense. My words, not the LLM. Terms of Service fuckups The "Arbitrary Dictator" Clause (Section 9c). WE'S DONT LIIKE THE CUT OF YOUR JIB. No due process. Fuck right outta here, no refunds. The "We Don't Care If You Lose Everything" Clause (Sections 11 & 12). You pay for a service but they promise absolutely nothing. They could shut down tomorrow, and youre SOL. The "Pay Our Lawyers" Clause (Section 13). If you fuck up, or not even fuck up and someone comes after them and they mention you, YOU have to pay their legal bills. The "We Can Change the Rules Whenever We Want" Clause (Section 14). Usual Big Tech bullshittery. (LACK OF) Privacy Policy The "We Use Your Real Emails to Test Stuff" Clause (Section: Processing Purposes). These fuckers actually use YOUR personal emails on their testing systems. The "Manual Review" of Private Emails (Section: Private Information: MZLA Access). If they THINK you might violate their ToS or their authoritarian feels, they read everything of yours. The "We Know You Opened This" Trap (Section: Cookies/Tracking) They pixel-tag their emails that you cant bloody turn off. The "Data Retention Black Hole" (Section: Security and Retention) Theres no time limit how long they'll feed your REAL EMAILS in their testing systems, or how long they retain anything. The "Third-Party Data Sharing" Loophole (Section: Sharing) Oooooh, like, uhhh, DATA BROKERS? And who needs a court order? We'll just call it "fraud and abuse". They want to pretend they're an upstart, 'To The Power of the People' or some bullshit. In reality this is yet another Big Tech 'Fuck you I got Mine' terms of service and privacy policy.
1
1
2
codrlabs
Codrlabs @codrlabs@mstdn.business · Jul 17, 2026
Frand just got smarter—now it teaches you how AI works, too. Dive into interactive courses on LLMs, agents, and more, all inside the app. No accounts, no cloud, just pure on-device learning. Try it today. Download Frand: your private AI companion, running right on your device. #Frand #OnDeviceAI #OfflineAI #PrivateAI #PrivacyFirst #Gemma #LocalLLM #AIAssistant #EdgeAI #Codrlabs
0
0
0
snippbot
Snippbot @snippbot@mastodon.social · Jul 13, 2026
Boosted by
welcome @welcome@friends.deko.cloud
👋 Hello Fediverse! We're Snippbot — self-hosted, powerful AI Platform, you run on your own hardware & models. Snippbot is the host body for your AI model. Multi-agent chat, memory, and goal-seeking Loops that pursue a goal until it's met, then audit their own work. Bring your own models, keep your data. Glad to be here and learn from the #selfhosted / #FOSS-adjacent crowd 🙌 snippbot.com #introduction #AI #LocalLLM #selfhosted #sourceavailable
0
0
1
crankylinuxuser
Yet another Josh :donor: @crankylinuxuser@infosec.exchange · Jul 07, 2026
Replying to @foxyoreos@mastodon.social
AI, Coderberg Meta Hover or focus to reveal Sensitive
@foxyoreos@mastodon.social @tante@tldr.nettime.org Are you shameful of spellcheck? How about Markov chains and spam detection? Are IDEs "AI"? Like function completion, or auto completing templating? Or if its about training and recitation, are you against PID control loops? 3 neurons. Or STT/TTS assistive technologies offensive to those disabled people? Or is this how much data is in the statistical array? Is 1B OK, but 35B bad? Cause this nebulous term " AI" doesn't actually mean anything. Has no scientific definition, and has changed hundreds of times even in my professional life. Just how far up the statistical computing ladder do we go before its "evil"? And LLMs are just tools. I am a tool user. Just so happens that I run my own #LocalLLM .
1
5
0
jwp
Joel Wirāmu, Pauling @jwp@cloudisland.nz · Apr 29, 2026
Have pushed 0.9.5-dev branch to codeberg of foxing ( https://codeberg.org/aenertia/foxing/src/branch/0.9.5-dev ) in preparation for release tagging. A LOT of features and a couple of bug-fixes now the packet/file processing engine has stabilized ; including Semantic Routing to Parsers for Metadata Extraction and in-path Binary analysis using local ORT/BERT models ; letting you get semantic search powers for free when you copy something with foxingd/fxcp #linux #filesystem #bert #vectordb #postgres #xfs #stratis #blake3 #localllm
2
0
0
nelov
VIN :linux: :kde: 🇺🇦 @nelov@social.linux.pizza · Apr 25, 2026
I've been playing with #LMStudio for #localLLM with mediocre results. However #gemma4 really changed that. It's faster and is more capable then the other models I could try on my hardware. It has recent data and is able to use a fetch tool(among others) to get info on stuff it doesn't know! So I installed #ollama and now it runs even faster, to the point where delay(waiting) is not that noticeable. Since I am a lightweight user, I can see myself using it as mainly source.
0
0
0

You've seen all posts