Post #2130753

Distillation: “Modern LLM processes could look like using a GPT API to build an initial batch of synthetic data to build a specialized small data-processing model.” https://www.interconnects.ai/p/the-distillation-panic I imagine how BYTE would have covered this era and I miss it again. There really has never been an adequate replacement. #jgshare