Post #4263821

@ikesau@micro.ikesau.co @kini@maro.xyz I would/will share these worries when open source models stop being shipped. It feels weird to say but right now China is basically helping us all by doing a lot of their work in the open. However, there seems to be this assumption that we currently understand how frontier LLMs work. We really don't. The amount and quality of emerging properties that came from refining training methods, increasing the number of parameters, etc. is very high. We do not really understand how these emerging properties came to be. So we go from "we dont understand how this thing works when w traeined it" to "we don't understand how this thing work when the AI trained it". Both of those things are terrifying because we don't understand it, not because of who trained it