Post #2330228

@marcoarment just listened to your episode about your Mac Mini server rack. You can and should absolutely try to run your own small LLM cluster before going to the big AI companies. I work at Modular AI (co-founded by Chris Lattner). You can self-host our MAX runtime, which has native support for running open weights models on Apple Silicon. https://www.modular.com/open-source/max