Skip to content
Live
Trending storyPast story

OpenRouter Refactoring Supplier Routing Algorithm

1 reports1 outlets22 days agoUpdate

The story so far

AI overview

OpenRouter has released a new supplier routing algorithm that selects the best cost-performance solution for each request by evaluating price, latency, throughput, and error rate in real time, significantly improving reasoning speed (TTFT improved by 16.9%), throughput (improved by 16.3%), and reliability (error rate reduced by 67%), with only a slight increase in cost of 6.0%. This algorithm rewards suppliers that provide high-quality reasoning without requiring users to modify their code, ensuring a continuously optimized experience.

AI-written from the reports · Updated 21 days ago

Coverage timeline

Follow the coverage to see every side of the story.

28 Oct
  1. OpenRouter Blog
    How we rebuilt provider routing for better, faster inference

    OpenRouter has released a new supplier routing algorithm that selects the best cost-performance solution for each request by evaluating price, latency, throughput, and error rate in real time, significantly improving reasoning speed (TTFT improved by 16.9%), throughput (improved by 16.3%), and reliability (error rate reduced by 67%), with only a slight increase in cost of 6.0%. This algorithm rewards suppliers that provide high-quality reasoning without requiring users to modify their code, ensuring a continuously optimized experience.