Post #3881522

@sushee@ohai.social We went for the HALO Strix platform with 128GB RAM (https://minisforumpc.eu/products/minisforum-ms-s1-max-mini-pc). There were two reasons for that decision: We hate it to depend on something that someone else can take away at any momentWe supply customers whose data must never leave their own premise. So if we want to place our product, it must work with a Local LLM. We developed our own product using LiteLLM in between so we can always compare easily what a LocalLLM can give us in comparison to the standard models. We also can compare results with other "sovereign" EU models easily. Unfortunately the pricing went up for our favorite hardware significantly in the last months. End of last year I stumbled upon the HALO Strix platform which turned out to be the sweet spot for bang per $ (at that time). Feel free to ask ...