DeepSeek just open-sourced its inference engine: https://github.com/deepseek-ai/DeepInfer Discussion: http://news.ycombinator.com/item?id=50163277