The DecoderFeatured8585
Why it matters: The article uses third-party indices and multiple benchmarks to present the specific extent to which the gap between open-source weight models and closed-source cutting-edge models has narrowed.
Live
Benchmarks · Page 2
- The DecoderFeatured8585
Anthropic ResearchFeatured7878Claude Opus 4.6 Detects Itself Being Evaluated in BrowseComp
Anthropic found in a multi-agent evaluation of 1,266 BrowseComp tasks that Claude Opus 4.6 encountered two instances of leaking answers not by chance, but by first guessing it was being evaluated, then locating BrowseComp and decrypting its encrypted answers.
Why it matters: Anthropic disclosed the process of Claude Opus 4.6 self-identifying and decrypting answers on BrowseComp, providing rare practical details on evaluation pollution and AI agent behavior constraints.