LangSmith has launched the public beta version of LLM Gateway, providing runtime control for production agents.
LangSmith LLM Gateway has entered public beta, serving as a centralized governance layer between agents and models, uniformly executing spending limits, rate limiting, model fallback, and sensitive data deidentification. Spending and rate limiting can be set at four levels: organization, workspace, API key, and user. When the limit is hit, the agent receives a 402 response; fallback rules can take effect uniformly across models and hosting providers.
Why it matters: The original text listed the specific control levels of the gateway in terms of cost, rate limiting, fallback, and data masking, which can help determine at which level the governance of the production intelligent agent should be placed.

