Deepseek open-sources the inference engine that powers its fastest and cheapest AI model
Deepseek open-sources the inference engine that powers its fastest and cheapest AI model
DeepSeek open-sources its internal reasoning framework DeepInfer under the Apache License 2.0, a service software that supports the large-scale and fast answer generation of the V4.1-Flash model.
Same story2 other outlets also reported this
- MarkTechPost··First
DeepSeek open-sourced the DeepInfer inference framework, supporting DeepSeek-V4.1-Flash.
- The Decoder··+4 h 24 min·Reading now
DeepSeek open-source reasoning engine DeepInfer supports high-speed, low-cost operation of V4.1-Flash
Adds:The Decoder mentions the Apache License 2.0.
- Synced··+43 h 42 min
DeepSeek open-source reasoning framework DeepInfer and token encoding/decoding component deepseek-recipe
Adds:Machine Learning mentions the 82% AI profit margin.
In order of publication · later reports are added as they appear · Compared by AI from each outlet’s title and summary
Deepseek has open-sourced DeepInfer, its internal inference framework, under the Apache License 2.0. Inference is how a trained AI model handles requests and generates responses. DeepInfer is the serving software that lets Deepseek's V4.1-Flash model produce answers quickly at scale.
The framework builds on vLLM with optimized compute kernels, distributed processing across multiple chips, and faster text generation techniques. Code for future Deepseek models will also ship as open source. Deepseek is also releasing deepseek-recipe, which replicates the token processing of the official Deepseek API so self-hosted setups behave the same way.
Deepseek's models are already dirt cheap. DeepInfer fills the last gap for running them even more cheaply. The goal is "to help the community lower compute costs, reduce energy use, and make AI more affordable," the company said on X. But the release also adds pricing pressure on Western providers like OpenAI and Anthropic. Given the AI race between China and the US, the move could be politically motivated too. If Western AI companies miss their growth targets, that's a risk for the US economy and beyond.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Source: The Decoder · the-decoder.com