Post #3287666

2026-06-03 15:06 UTC

I sometimes wonder if there's an possible future where we can somehow make search _better_ instead of _worse_ with LLM technology, like making it easier to find relevant things that humans wrote and discover new cool people and learn from them instead of hiding everything behind a wall of AI summaries that are often wrong i've been trying duckduckgo and kagi but it has not been a great experience for me (please don't tell me that you can ask generative LLMs to do searches) (2/?)

Replies (4)

@reykjalin@social.treehouse.systems 2026-06-03 15:11

@b0rk@social.jvns.ca I’m personally excited for a future where tiny but hyper specialized models you can run on your own computer are available. I don’t think I ever need these generally-“good”-at-everything style models. But something tiny that’s really good at React? Or testing strategies? Or finding articles written by people? I think I’d love that

Open ##3287709
@xpomul@norden.social 2026-06-03 15:14

@b0rk@social.jvns.ca I think there might be. The maths behind searching is creating a matrix of occurrences of words and compressing that matrix (Latent Semantic Indexing). In a very simplified way, LSI is like an LLM with a context of 0. So I guess LLMs which are also only matrices might be used in a similar way… (I am not very deep into the maths and theory of LLMs, but aren’t embeddings something in the direction you are looking for?)

Open ##3287719
@tom@labyrinth.social 2026-06-03 15:14

@b0rk@social.jvns.ca I can definitely imagine a few ways LLMs could make a search experience "better" but idk if the amount of "better" is worth the resources

Open ##3287720
@d6@merveilles.town 2026-06-03 15:19

@b0rk@social.jvns.ca one of the really sad things about this moment is that it seems like LLMs work best (fsvo "work" and "best") when interfacing between a person and a predictable/reliable/deterministic thing (such as a programming language type system for example) but instead people seem to be trying to replace all the predictable/reliable/deterministic things in our world with LLMs (which are not predictable, reliable, or deterministic). i feel this is especially true for search engines.

Open ##3287724