Post #3287709

2026-06-03 15:11 UTC

@b0rk@social.jvns.ca I’m personally excited for a future where tiny but hyper specialized models you can run on your own computer are available. I don’t think I ever need these generally-“good”-at-everything style models. But something tiny that’s really good at React? Or testing strategies? Or finding articles written by people? I think I’d love that

Replies (1)

@zwol@masto.hackers.town 2026-06-03 17:12

@reykjalin@social.treehouse.systems @b0rk@social.jvns.ca Serious research question: suppose a search engine that uses an LLM to *interpret queries* but not to produce text; the output is the traditional set of documents that seem to be statistically relevant to the query. The search engine's operators will need to train the model on the documents it can retrieve. How much *additional* natural-language text will they need to feed in to get something that does acceptably well at query interpretation? possibly relevant to @marginalia@mastodon.social

Open ##3287710