Post #67724
2025-12-16 00:28 UTC
like the LLM that was finding cancers and people were initially impressed but then they figured out the LLM had just correlated a DR’s name on the scan to a high likelihood of cancer. Once the complicating data point was removed, the LLM no longer performed impressively. Point #2 is very Goodhart’s law adjacent.
Replies (1)
-
@bitjunkie@lemmy.world 2025-12-16 21:33
I never knew the name for this law, but it’s basically how SEO ruined traditional search. I think it’s also a big reason that a LOT of software engineers put way too much emphasis on passing unit tests and not nearly enough on examining what they’re actually testing.