Post #3300618
2026-06-03 16:27 UTC
I got it up and running yesterday. You run ollama llms through it but it has some fun/useful tools like getting multiple models to give answers to the same question and voting on the correct answer.
Its more a quality-of-life thing, basically.
Replies (2)
-
@TrippinMallard@lemmy.ml 2026-06-05 04:57
You’re not tied to ollama. you can choose other options like llama.cpp, vLLM, etc.
-
@Transparent_knoll@awful.systems 2026-06-05 05:51
I wonder how it compares to open WebUI, which is likely what most self hosters are using to access their LLMs.