Post #3557669
2026-07-02 17:33 UTC
They just don’t call it model collapse, and that fixes the problem. (Somebody on bsky said ‘hey that isn’t actually model collapse, read this article on it written by the AI company’. And then the article described model collapse, but didn’t call it model collapse, it was amusing. (And I went into it, thinking I could be wrong, going ‘ah so it is only related to a specific set of instructions’, but then the article also showed that models without those instructions had the the problem (in a much smaller way, but the bad instructions were spreading due to synthetic data))).
Replies (1)
-
@scruiser@awful.systems 2026-07-03 14:18
They just don’t call it model collapse, and that fixes the problem. Reminds me of OpenAI’s blog post explaining the goblins. It described textbook model collapse, but somehow avoided saying the actual words “model collapse” even once.