Skip to content
Live
Trending storyPast story

Open model inference market estimation and challenges

1 reports1 outlets14 days agoUpdate

The story so far

AI overview

Interconnects estimates the open-source model inference market to be growing nearly exponentially by analyzing the token volumes of companies like Baseten, Fireworks, and Together AI. Fireworks serves over 40T tokens daily, but does not provide direct comparison data with OpenAI/Anthropic. Nathan Lambert's research note, 'Interconnects Dashboard,' aims to answer questions about the market size and its comparison with business models, emphasizing that the current estimates' limitations lie in the lack of direct comparisons.

AI-written from the reports · Updated 14 days ago

Coverage timeline

Follow the coverage to see every side of the story.

5 Nov
  1. Interconnects
    How big is the open model economy today?

    Interconnects estimates the current scale of the open model economy by analyzing the token volume of open model inference startups like Baseten, Fireworks, and Together AI, showing it is growing nearly exponentially, with Fireworks already serving over 40T tokens daily, but lacking direct comparison data with OpenAI/Anthropic.