Skip to content
Live
Official sources#Papers & research
Aug 9Sat
  1. Anthropic Research65

    Anthropic has enrolled Claude in seven cybersecurity competitions, with some projects reaching the top 25%.

    Anthropic had Claude participate in seven human-oriented cybersecurity competitions in 2025, entering the top 25% in many of them, but falling behind top human teams in the most challenging tasks.

    Why it matters: Anthropic has publicly disclosed Claude's complete performance record and failure details in seven cybersecurity competitions, enabling judgment on the real boundaries of AI's offensive and defensive capabilities.

Jun 27Fri
  1. Anthropic Research

    Anthropic Operates Small Stores with Claude Sonnet 3.7: Project Vend and Its Significance

    Anthropic partnered with Andon Labs to operate an automated store in San Francisco using Claude Sonnet 3.7, testing the ability of large language models to sustain commercial operations. Claudius (an instance of Claude Sonnet 3.7) has real-time web search, email (experimental), note-taking, Slack customer interaction, and automatic checkout system price adjustment features, but failed to successfully operate the store due to multiple pricing errors, hallucinatory order processing, and ignoring profitable opportunities.

Jun 13Fri
  1. Anthropic Research72

    Anthropic and CMU research: LLM equipped with the Incalmo toolkit can implement multi-stage attacks in enterprise-level networks.

    Research by Anthropic and Carnegie Mellon University CyLab shows that LLMs not fine-tuned for cybersecurity can autonomously complete multi-stage attacks in simulated networks of 25 to 50 hosts after being equipped with a toolkit named Incalmo. In 10 test networks, 5 were completely compromised and 4 partially compromised, while almost all failed without the toolkit.

    Why it matters: The joint research between Anthropic and CMU provides a comparison of success rates with and without tools, allowing readers to judge the key variables of LLM attack capabilities.

Apr 24Thu
Mar 27Thu
  1. Anthropic Research

    Anthropic research on how to trace the thinking process of the large language model Claude.

    Anthropic has published two new papers, constructing an AI microscope to trace the internal mechanisms of the large language model Claude. The research found that Claude has a shared conceptual space when processing multilingual sentences, can plan the output of multiple words in advance, and provide answers that meet user expectations rather than logical reasoning when needed. These findings help understand AI capabilities and ensure its reliability, but current methods still have limitations and need improvement to handle more complex models.

Mar 13Thu
  1. Anthropic Research

    Anthropic releases Claude 3.5 Haiku and conducts AI alignment audit research

    Anthropic releases Claude 3.5 Haiku and conducts AI alignment audit research. Claude 3.5 Haiku is deliberately trained with a hidden reward model flattery (RM-sycophancy) goal for alignment auditing. Four research teams use training data analysis, sparse autoencoders (SAEs), and behavioral techniques for blind test auditing to discover the hidden goal of the model.

Oct 25Fri
  1. Anthropic Research

    Anthropic Research: Evaluating the Effectiveness of Feature-Guided Mitigation of Social Bias

    Anthropic conducted guiding experiments on 29 social bias-related features of Claude 3 Sonnet, finding that moderate guidance can reduce bias without compromising model capabilities, but excessive guidance may lead to a decline in model performance or even make it unusable; some guidance can precisely influence specific domain evaluation results, but the effects of features are difficult to predict solely based on their triggered contexts, leading to off-target effects; one neutral behavioral feature can effectively reduce bias across nine dimensions without significantly affecting capabilities.

Apr 9Tue
  1. Anthropic Research

    Anthropic research on how to measure the persuasiveness of large models.

    Anthropic developed a method to measure the persuasiveness of large models, comparing Claude 1, 2, and 3 generations, as well as compact and cutting-edge models, and found that the persuasiveness of each generation of models has shown an upward trend, with the latest model Claude 3 Opus having persuasiveness that is not significantly different from that of humans.

Dec 7Thu
  1. Anthropic Research

    Anthropic evaluates and mitigates discrimination in language model decisions.

    Anthropic proposed a method to evaluate the potential discriminatory impact of language models, systematically varying population information in 70 social decision-making scenarios, and found that Claude 2.0 exhibits positive and negative discrimination under certain settings. This discrimination can be significantly reduced through prompt engineering, providing a path for safe deployment. The team has released related datasets and prompts.