Post #3620260
2026-07-06 01:20 UTC
@astrid@woem.space we'd also ideally like to do it in a way that gives everyone a copy of the search index and all software needed to produce it
Replies (1)
-
@astrid@woem.space 2026-07-06 01:27
@ireneista@adhd.irenes.space i have done a small amount of research into how this could be done. you can definitely go with https://commoncrawl.org/ to start out with, instead of crawling sites yourself. i feel like the governance and funding is the bigger issue, though. search engines become shit when they become ad engines. if i were to operate something like this, it would either have to be a money sink hobby thing i give only to friends, or an explicit "pay a subscription for access" type thing.