Skip to content
Live
Trending storyPast story

Continual Learning Exam released

1 reports1 outlets23 days agoUpdate

The story so far

AI overview

Hugging Face has released the Continual Learning Exam (CLE), a benchmark containing 120 real tasks, 600 progressive levels, and 89 professions, for evaluating the long-term continual learning and experiential learning of LLM agents. Tested 17 cutting-edge configurations, the strongest system Claude Code + Opus 5 only completed 47.7% of the levels and 23.3% of the task steps.

AI-written from the reports · Updated 22 days ago

Coverage timeline

Follow the coverage to see every side of the story.

27 Oct
  1. Hugging Face Daily Papers
    Continual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents

    Continual Learning Exam (CLE) released, a benchmark including 120 real tasks, 600 progressive levels, and 89 professions, for evaluating the long-term continual learning and experience learning of LLM agents. Tested 17 cutting-edge configurations, the strongest system Claude Code + Opus 5 only completed 47.7% of the levels and 23.3% of the task steps.