Post #3287720
2026-06-03 15:14 UTC
@b0rk@social.jvns.ca I can definitely imagine a few ways LLMs could make a search experience "better" but idk if the amount of "better" is worth the resources
Replies (1)
-
@kfm@mastodon.social 2026-06-03 15:22
@tom@labyrinth.social @b0rk@social.jvns.ca yeah, my team made this at a prior company. The audience was lawyers and government professionals in a fairly specific, though complicated, compliance vertical. The first result of our user testing was 'we refuse to believe any generated results without links back to source law'. A multiphase approach using RAG and then a large context window yielded incredible results, but it was definitely heavy and costly.