Post #3822572

Weird argument, since distillation doesn’t give you the AI. It just gives you the style of the AI. If you distilled Google’s newest Gemini into a GPT-2 model, all it would do is just sound like it. Your GPT-2 model isn’t suddenly going to be as capable as the model you distilled.