← Feed
@troed@swecyb.com @briankrebs@infosec.exchange okay, so we're accepting anecdotal evidence? Every time that I've tried GenAI, it's been a mess, error prone, and wasted my time.
Just two days ago, I tried to use GenAI to help with a problem. It's first response was wrong and outdated. I pointed out it was missing current functionality. It's updated, second response still turned out wrong. My actual results in terminal did not match its claims and the actual source code for the functionality also indicated it was wrong. When I pointed this out, it was all, "You're right! Here is the actual...."
A month ago, I was asking for help with a subject. Thirty minutes (or more) into the session, after manually reviewing product documentation I realized the GenAI solution was just poorly written and could never work. I pointed out its incorrect foundational component and it corrected its response. So, its suggestion now worked but it was insecure. I pointed out that this was an insecure implementation and that its answers should include secure principles. Well, unsurprisingly, this didn't stick and it was still suggesting or "forgetting" to apply secure designs.
This has been my experience nearly every time. It's just wrong and I have to guide it like a moronic intern. I can't trust anything that it generates. And, this is just my anecdotal evidence.
Actual research, studies, and the news show and support that GenAI technology cannot be trusted. Every week we read or hear about some bullshit GenAI content. Even the GenAI companies themselves admit this by reminding everyone that a human needs to review GenAI output.
This is just discussing the functionality side of GenAI. It's also a disaster for the environment, intellectual property, the global market, the job market, mental health, local communities, the open Internet, and much more.
I think it was Sam Altman that even admitted that if GenAI companies were held accountable to intellectual property laws the companies and technology would gail. A little over a decade ago, Aaron Swartz was prosecuted to point of suicide just for accessing content he had a legal right to access. Yet, these billion dollar companies are giving free reign to magnitudes more protected content.
Society is being used to socialize the R&D costs of Alpha-level technology and its consequences.
These GenAI tools nearly all phone home and share private data with massive corporations and governments. They're a privacy and intellectual property nightmare. Are you using End-to-End Encryption (E2EE)? Well, that doesn't matter much when you have a spy bot or software scanning, monitoring, and reporting your data and conversations to Big Brother.
I will wrap with a final asks:
1. if GenAI technology is so amazing then why is it being forced into everything and onto everyone? I don't recall the iPod or iPhones being forced on consumers. I don't recall any recent amazing technology having to be forced onto consumers.
2. If GenAI is truly such a multiplier then why are these companies sharing it and forcing it on everyone? Shouldn't they be keeping it secret and proprietary while they crush their competition? Why are so many of these big companies scaling back their actual usage of GenAI tools?
3. If GenAI is truly so accurate then why do most experts decry its usage in their field? Isn't it weird how it is mostly executives and non-experts pushing this technology so heavily when they are not qualified to judge capabilities?
Etc
Etc
Etc.
#GenAI #AISlop #LLM
Replies (1)
-
@seanm@infosec.exchange GenAI are not databases. You seem to want them to be, and when they aren't you claim that they're useless.
Today I asked my local LLM to set up my workstation as a build server for my two servers, since it's much more powerful and the servers need their CPU capacity for their main serving content job.
The Superpowers plugin in Opencode (the LLM harness) enforces a strict analysis (searching for information about the task), design (asking me if it's what I had in mind) and architecture (full implementation plan with details on the actual solution). The implementation flow follow Test Driven Development which means that every single step has an OK/NOK gate.
All implementation is done with a controlling agent handing out tasks to subagents. When one says it's done another agent reviews against spec.
I now have a fully working build server.
Have you actually tried to learn an LLM workflow?
@briankrebs@infosec.exchange
Open ##4566313