OpenRouter Refactoring Supplier Routing Algorithm
The story so far
OpenRouter has released a new supplier routing algorithm that selects the best cost-performance solution for each request by evaluating price, latency, throughput, and error rate in real time, significantly improving reasoning speed (TTFT improved by 16.9%), throughput (improved by 16.3%), and reliability (error rate reduced by 67%), with only a slight increase in cost of 6.0%. This algorithm rewards suppliers that provide high-quality reasoning without requiring users to modify their code, ensuring a continuously optimized experience.
AI-written from the reports · Updated 21 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- OpenRouter BlogHow we rebuilt provider routing for better, faster inference
OpenRouter has released a new supplier routing algorithm that selects the best cost-performance solution for each request by evaluating price, latency, throughput, and error rate in real time, significantly improving reasoning speed (TTFT improved by 16.9%), throughput (improved by 16.3%), and reliability (error rate reduced by 67%), with only a slight increase in cost of 6.0%. This algorithm rewards suppliers that provide high-quality reasoning without requiring users to modify their code, ensuring a continuously optimized experience.