Post #3254175
2026-06-06 19:18 UTC
Replies (2)
-
@orionkidder@writing.exchange 2026-06-06 19:18
@grammargirl@zirk.us If I understand correctly, it shoves every query through the "AI" multiple times and tests whether it does the thing it's asked to do, but of course, it hides all of that from the user.
-
@CppGuy@infosec.space 2026-06-07 08:24
@orionkidder@writing.exchange @grammargirl@zirk.us I'm obliged to use LLMs at work. In my limited experience, the error rate depends on whether the question you ask is covered by the model's training data. If so, the error rate will be fairly low (though not so low that the model becomes trustworthy). Otherwise, the error rate will approach 100% as the model just makes something up. Of course, you never know what was in the training data, so you don't even know how reliable you can expect the model to be. In my experience, asking an LLM about material you can't find with a careful Web search is a good way to produce a screenful of friendly, grammatical, plausible rubbish.