Skip to content
Live
Trending storyPast story

Factors influencing the CoT monitoring capability of GPT-6 Astra

1 reports1 outlets9 days agoUpdate

The story so far

AI overview

OpenAI released a research paper stating that the thinking chain (CoT) monitoring ability of GPT-6 Astra is affected by pre-training, architecture, reinforcement learning, and model-generated data. In non-adversarial settings, GPT-6 Astra's CoT monitoring ability decreases, while in adversarial tests, CoT escape ability increases, and there is no significant improvement in CoT ability. In pre-training, the lack of CoT ability increases as the base model's perplexity decreases, architecture has a limited impact, reinforcement learning enhances CoT control ability, and model-generated data fine-tuning can transfer CoT control ability. Model perplexity is positively correlated with the lack of CoT ability and control ability.

AI-written from the reports · Updated 8 days ago

Coverage timeline

Follow the coverage to see every side of the story.

10 Nov
  1. OpenAI Alignment Blog
    What Affects CoT Monitorability Across The Model Lifecycle?

    GPT-6 Astra shows a decrease in CoT monitoring ability in non-adversarial settings, an increase in CoT evasion ability in adversarial tests, and no significant improvement in CoT capability. During pre-training, CoT capability does not increase with the decrease of the base model's perplexity, and the architecture has a limited impact. Reinforcement learning enhances CoT control ability, and model-generated data fine-tuning can transfer CoT control ability. Model perplexity is positively correlated with CoT capability and control ability.

Heat over time

Now
3
Peak
312 Nov, 06:00
24h change
–

Hover or tap the chart to see each hour; use the arrow keys on a keyboard.