Skip to content
Live
Trending storyDeveloping

Salesforce launches cross-regional inference routing

1 reports1 outlets1 hour agoUpdate

The story so far

AI overview

Salesforce deployed cross-regional inference routing in Amazon SageMaker AI, extending model services to over 30 global regions. It routes requests to the currently healthiest endpoint via a router, addressing availability issues caused by fragmented regional capacity. The router dynamically adjusts traffic allocation based on health checks and capacity signals, prioritizing local endpoints, keeping cross-regional traffic below 5%, and automatically falling back in case of failure, without requiring changes to existing application code.

AI-written from the reports · Updated 1 hour ago

Coverage timeline

Follow the coverage to see every side of the story.

19 Nov
  1. AWS Machine Learning Blog
    How Salesforce is advancing global-scale model serving with cross-Region inference routing in Amazon SageMaker AI

    Salesforce deployed cross-regional inference routing in Amazon SageMaker AI, extending model services to over 30 global regions. It routes requests to the currently healthiest endpoint via a router, addressing availability issues caused by fragmented regional capacity. The router dynamically adjusts traffic allocation based on health checks and capacity signals, prioritizing local endpoints, keeping cross-regional traffic below 5%, and automatically falling back in case of failure, without requiring changes to existing application code.

Heat over time

Not enough data yet to draw a trend.