Post #3166117
2025-08-12 06:15 UTC
You also want a high level of correctness. Very high level. Consider how often you encounter compiler bugs. Compare that with the frequency with which you experience AI hallucinations. It's not even a close competition.
Hallucinations are a feature of how LLMs work.
Replies (2)
-
@kevlin@mastodon.social 2025-08-12 06:20
There is a hope that incorrect output can be fixed with better 'alignment'. Alignment is a euphemism for hacking and filtering input/output of an LLM to stop it from producing results that are considered unacceptable. In other words, to stop the LLM producing what the LLM would normally produce. It's basically a bug filter that by its nature needs to be constantly updated in response to feedback and complaints. It is by its nature volatile and never complete.
-
@jasongorman@mastodon.cloud 2025-08-12 06:20
@kevlin@mastodon.social Or, at the very least, be predictably wrong.