Open model inference market estimation and challenges
The story so far
Interconnects estimates the open-source model inference market to be growing nearly exponentially by analyzing the token volumes of companies like Baseten, Fireworks, and Together AI. Fireworks serves over 40T tokens daily, but does not provide direct comparison data with OpenAI/Anthropic. Nathan Lambert's research note, 'Interconnects Dashboard,' aims to answer questions about the market size and its comparison with business models, emphasizing that the current estimates' limitations lie in the lack of direct comparisons.
AI-written from the reports · Updated 14 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- InterconnectsHow big is the open model economy today?
Interconnects estimates the current scale of the open model economy by analyzing the token volume of open model inference startups like Baseten, Fireworks, and Together AI, showing it is growing nearly exponentially, with Fireworks already serving over 40T tokens daily, but lacking direct comparison data with OpenAI/Anthropic.