Post #128633

2026-01-13 07:46 UTC

Doesn't work, but I guess if it makes people feel better I suppose they can waste their resources doing this. Modern LLMs aren't trained on just whatever raw data can be scraped off the web any more. They're trained with synthetic data that's prepared by other LLMs and carefully crafted and curated. Folks are still thinking ChatGPT 3 is state of the art here.

Replies (3)

@Disillusionist@piefed.world 2026-01-13 08:20

From what I’ve heard, the influx of AI data is one of the reasons actual human data is becoming increasingly sought after. AI training AI has the potential to become a sort of digital inbreeding that suffers in areas like originality and other ineffable human qualities that AI still hasn’t quite mastered. I’ve also heard that this particular approach to poisoning AI is newer and thought to be quite effective, though I can’t personally speak to its efficacy.

Open ##2720185
@XLE@piefed.social 2026-01-13 11:54

Do you have any basis for this assumption, FaceDeer? Based on your pro-AI-leaning comments in this thread, I don’t think people should accept defeatist rhetoric at face value.

Open ##2720210
@KeenFlame@feddit.nu 2026-01-13 19:45

Ai devalues datasets when it refines, many resources are aimed towards solving the degradation that occurs when ai trains on ai. Gradients become poor and quality follows

Open ##2720230