Post #3826464

Famous Tech Writer: "A Large Language Model (LLM) is like a small zip file that contains all human knowledge. It [...] compress[es] all of human writing into a small working model that could run on one single GPU chip. [...] In a strange but real way the resulting tiny file contains all the information that is on the internet and in our libraries." :kermit_shout: Without ANY irony, two headlines down on the page is "The hoaxter who claimed he could fit a whole movie in one kilobyte" 🫠 How can someone bloviate and profess to be knowledgeable about technology while clearly not understanding elementary fundamentals?! (His editor should've had a clue from the other headline alone!) A zip file is lossless. An LLM is not. The difference between "all the information that is on the internet and in our libraries" and an LLM is astronomical. And the structural information of webpages and books is nontextual, and is completely absent in LLMs. (Not linking the piece because incoherent, baseless hot takes from famous authors don't deserve traffic.) So, POLL! Do you understand zip files and LLMs? Do you think LLMs contain all human knowledge? #LLM #AI