asciimoo

How do i use environment variables to make a indexer? I couldn’t get it to work Repeatable config options are not supported from env vars. In this case you have to mount a config file to your container. But, if you want to track local files from docker, you have to mount those files/directories anyway. I suggest to use the standalone binary release if you’d like to track local files, it is way more convenient.

can i connect it to other services like paperless, or would i need to manually import files? Hister supports importing data from a few services, but paperless isn’t supported yet. More details: hister.org/docs/import Is it better to run it in docker or e.g. a LXC in proxmox? If i want to index files, it seems it needs the config.yml file Docker is perfectly fine. Every settings option from the config file can specified using environment variables. The syntax is HISTER__[SECTION]__[OPTION]=[VALUE]. After just playing with it for a day, the disk usage is 150 MB Probably most of the disk space is occupied by the Hister binary which contains all the N-grams required to identify ~30 languages. The index should be much smaller. I figure I should use postgres instead of sqlite. SQLite is more than enough for personal use, but if you prefer to use postgres, just specify the standard DSN formatted connection data to the server.database config option: hister.org/docs/configuration#database-backends how to set that up, preferably with docker Use the HISTER__SERVER__DATABASE=“host=localhost user=hister password=hister dbname=hister port=5432” environment variable. I am not familiar with pgvector Hister automatically creates the database model and handles the migrations if required.

Though maybe the resource folder can be ignored and the html file can already be imported? It depends. Hister always requires a unique URL for each document. SingleFile snapshots include the original URL of the document as a meta HTML element. I’m not sure if the built-in page saver provides URL information.

Oh damn this could replace the bookmakers. The inspiration for Hister was a bookmarking app, but I realized that I always forget to manually trigger the bookmarking and I miss so many great resources. Would it be possible to attach an HTML file from like single file Currently you can import SingleFile HTMLs using the hister import file command, but no further integrations are implemented yet. Although, rendering the exact SinglePage file as a preview can be added relatively quickly. It would be also nice to accept files directly from the SingleFile extension. Thanks for the good suggestion, I’ve added it to my TODO! =]

Hi everyone, I am the original author of Searx. I started Hister with a similar motivation: reducing our dependence on external search engines while keeping searches and personal data under our control. Searx is a metasearch engine that forwards queries to other search providers. Hister takes a different approach. It builds a private full text index from content you choose, then searches that index entirely on your own infrastructure. Hister can automatically index pages through its Firefox and Chrome extensions. It can also watch local directories, import browser history and bookmarks, index individual URLs, and crawl complete documentation sites. The feature I find most useful is offline previews. Hister stores the readable content and HTML of indexed pages locally. You can open a result in a clean and sanitized preview beside the search results without visiting the original website again. Some other features: Full text search across web pages, PDFs, docx files, Markdown, OrgMode and text files Phrase searches, field filters, date filters, wildcards, negation, aliases, labels, facets, and result priorities Optional semantic search using an embeddings endpoint you configure Persistent website crawls Imports from browser history, Linkwarden, Karakeep, Shaarli, Wallabag, and Linkding Web, terminal, command line, HTTP API, and MCP interfaces SQLite and PostgreSQL support, plus optional multiple user hosting Hister cannot replace a global search engine (yet) for subjects you have never encountered because it only searches what you have indexed. My workflow is to search Hister first, then use its shortcut to fall back to traditional search when I need broader web results. The project is free software under the AGPLv3+ license. It can be installed as a standalone binary or with Docker. Project: github.com/asciimoo/hister Website and documentation: hister.org Small read-only demo: demo.hister.org I’d appreciate feedback, questions, and suggestions as well as joining our growing community. AI disclosure: AI assisted contributions are not strictly prohibited, but all contributions should be made by humans. More details: github.com/asciimoo/hister/…/CONTRIBUTING.md#ai-p…

I’d absolutely love to do this! It’s already on my future plans list: hister.org/support : Create infrastructure for importable, pre-indexed databases organized by topic, letting users quickly expand their local index with curated, relevant content. It could be a hub like Docker Hub, but for cool results. Exactly! Sorry. Ha ha. You know you have a good idea when people start asking for features. I haven’t even started it yet. <3 No need to apologize. I appreciate suggestions a lot (especially if those are well aligned with my ideas =] ).

It indexes pages which were already visited, right? Yes, if you use the browser extension only, but Hister has an API and a crawler as well if you’d like to add content you have not visited yet. Also, Hister supports indexing local text files, not just websites. Afterwards, that website is in my browsing history and if I need it again, I don’t need to search for it Unfortunately browser history does not include the page’s content only the URL + title combo at best. Browser’s can’t show an offline preview (Having offline previews is a huge privacy - and productivity - win in my opinion, it completely eliminates the need of creating external network requests) These are the biggest weaknesses of the browser history compared to Hister, but there are many more nuances where Hister can provide extra features and QoL improvements. I recommend checking the documentation & posts on the website if you are interested in the details.

Also how I would imagine it is default search there and if no hit then fallback to a default search engine, e.g. DDG. This is exactly how I use it. Hister has even a hotkey to quickly jump to your preferred online search engine with the current search query if you cannot find what you are looking for.

I’m working on a self-hosted search service called Hister with the goal to reduce my dependence on online search engines. Hister is a full text indexer for websites which saves all the visited pages rendered by your browser. It provides a flexible web (and terminal) search interface & query language to explore previously visited content with ease or quickly fall back to traditional search engines. I’ve been using it for a few months and as my local index is growing I can avoid opening google/duckduckgo/kagi more and more frequently. The project is still heavily under development with a growing community, but the current version is in a fairly usable state in my opinion, so I wanted to share it here - perhaps some of you find it useful as well. (Or at least have some constructive criticism =]) The code is AGPLv3 licensed, available at github.com/asciimoo/hister website: hister.org read-only demo: demo.hister.org About me: I develop privacy protecting and data liberating free software since 2008. I’m the author of Searx, Colly (github.com/gocolly/colly) and many more smaller free software/self-hosted projects (github.com/asciimoo).