Δτ-Bench Released: Evaluating the Ability of Agents to Adapt to Dynamic Tool Ecosystems
Δτ-Bench evaluates the ability of agents to adapt to dynamic tool ecosystems, finding that the current strongest model only achieves a 42.3% task success rate. Δτ-Bench includes 1,588 multi-round tasks across 42 domains and 6 ecosystem states. Steward achieves higher task success rates in ecosystem changes through incremental skill maintenance and dynamic resource allocation.

















