Continual Learning Exam released
The story so far
Hugging Face has released the Continual Learning Exam (CLE), a benchmark containing 120 real tasks, 600 progressive levels, and 89 professions, for evaluating the long-term continual learning and experiential learning of LLM agents. Tested 17 cutting-edge configurations, the strongest system Claude Code + Opus 5 only completed 47.7% of the levels and 23.3% of the task steps.
AI-written from the reports · Updated 22 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face Daily PapersContinual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents
Continual Learning Exam (CLE) released, a benchmark including 120 real tasks, 600 progressive levels, and 89 professions, for evaluating the long-term continual learning and experience learning of LLM agents. Tested 17 cutting-edge configurations, the strongest system Claude Code + Opus 5 only completed 47.7% of the levels and 23.3% of the task steps.