ALTK-Evolve: A cutting-edge model in the retail field
The story so far
ALTK-Evolve uses GPT-4.1 to learn and apply customer service scripts. In the τ²-bench customer service agent benchmark test, it surpasses all retail entries in the retail sector, achieving a score of 67.5% Pass^4, and does not require updating model weights. The model is based on a basic ReAct agent and GPT-4.1. It attempts to analyze tasks and use GPT-4.1 to distill success and failure into short behavioral rules, then adds these guidelines to the agent's system prompts without updating weights or manual annotation.
AI-written from the reports · Updated 27 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face BlogALTK-Evolve: How learned memory tops the τ²-bench leaderboard on customer service tasks without a frontier model
ALTK-Evolve uses GPT-4.1 to learn and apply customer service scripts. In the τ²-bench customer service agent benchmark test, it surpasses all retail entries in the retail sector, achieving a score of 67.5% Pass^4, and does not require updating model weights. The model is based on a basic ReAct agent and GPT-4.1. It attempts to analyze tasks and use GPT-4.1 to distill success and failure into short behavioral rules, then adds these guidelines to the agent's system prompts without updating weights or manual annotation.