Post #3121852

I view it differently. In the US, there are either megacorps, or "people in garages" which honestly don't have resources and stuff like legal support to do huge innovations. They publish cool papers, which never get implemented because they don't have $200k+ for a bigger test, and can't work on it themselves for a living. Any "garage devs" who get too big, get smited or amalgamated into Big Tech gray goo, and whatever was interesting gets lost in oblivion. There's no cooperation, no sharing, either. And OpenAI/Anthropic are *way* more conservative than you'd think. Same with Meta; they want results next quarter. Zuckerburg literally fired the whole Llama team, which put meta on the AI map and basically *founded* the open weights space, when they had *one* failed experiment. In other words, I'd argue clueless billionaires and the Tech Bro acolytes surrounding them are *poisoning* LLM development, and it's starting to catch up. *** In China, things are different. The GPU sanctions forced these gigantic companies like Alibaba or Tencent to be compute-thrifty, *but* they all seem to have access to suspiciously good training data... I would be the Chinese govt is helping them under the table. Chinese devs also have an interesting attitude; I would characterize them as "cooperative," with lots of private forum sharing going on, most models being open-weights, and clearly not a lot of desire to censor their models for the government. But they have their own forms of dysfunction too, sometimes by copying other firms a little to closely, or corporate/personal drama like anywhere.