Post #3942301

2026-06-21 19:52 UTC

Another fun thing is https://en.wikipedia.org/wiki/Model_collapse Feeding LLM output into LLM training is like sticking a microphone into a speaker to get a shrieking noise. LLM output is POISON to LLM training data, the compression math collapses with fairly small amounts of contamination. Finding clean sources of data was already a problem back in 2023. Another reason despite all the frantic scraping of the internet over the past few years, it keeps coming back to piracy: https://bsky.app/profile/lynnemthomas.com/post/3moksjjsyxk2a

Replies (1)

@landley@mstdn.jp 2026-07-19 21:05

If Moore's Law wasn't dead, the original curve would see 2026 introducing laptops with 64 terabytes of ram. http://catb.org/~esr/writings/world-domination/world-domination-201.html#id248066 Instead, LLM-induced DRAM shortages are _shrinking_ the amount of memory in systems. The largest mac mini for sale recently went from 64 gigs of ram down to only 16. https://www.techradar.com/computing/macs/apple-removes-more-mac-mini-and-mac-studio-models-from-sale-as-ceo-tim-cook-warns-it-may-take-several-months-to-reach-supply-demand-balance Note: Apple is once again the largest company in the world. https://www.forbes.com/sites/tylerroush/2026/07/17/apple-unseats-nvidia-as-worlds-largest-company/ And even they are rationing RAM.

Open ##3942300