Skip to content
Live
Trending storyDeveloping

OpenAI has launched an embedded evaluation program

3 reports3 outlets2 hours agoUpdate

The story so far

AI overview

OpenAI launched an embedded evaluation program in collaboration with Apollo Research, METR, Transluce, and Goodfire, for independent third-party evaluation of model alignment, safety protection, and monitoring systems. OpenAI had previously attempted to acquire Goodfire for over 5 billion US dollars but failed; researchers from Goodfire will join OpenAI to monitor model training processes using their own platform; Goodfire stated that it will gradually disclose some evaluation results. OpenAI held multiple meetings with the startup company Goodfire this summer to address AI security vulnerabilities, proposing an acquisition or collaboration for over 5 billion US dollars.

AI-written from the reports · Updated 1 hour ago

Coverage timeline

Follow the coverage to see every side of the story.

17 Nov
  1. 36Kr · AI
    OpenAI had previously discussed acquiring Goodfire for over $5 billion.

    OpenAI engaged in multiple discussions with the startup Goodfire this summer to address AI security vulnerabilities, proposing a purchase or collaboration worth over $5 billion. Goodfire is backed by Anthropic and focuses on analyzing AI model behavior and preventing runaway AI. The offer represents a significant premium over Goodfire's $1.25 billion valuation in February.

  2. ITHome · AI
    OpenAI and Goodfire have reached an AI safety collaboration, following previous discussions about a potential acquisition over $5 billion.

    OpenAI collaborates with Apollo Research, METR, Transluce, and Goodfire on model interpretability and safety evaluation; Goodfire researchers will be embedded at OpenAI to monitor model training processes using their own platform; OpenAI had previously attempted to acquire Goodfire for over $5 billion but failed, and Goodfire states it will gradually make some evaluation results public.

16 Nov
  1. OpenAI News
    OpenAI launches the Embedded Evaluation Program in collaboration with Apollo Research, METR, Transluce, and Goodfire

    OpenAI has launched the Embedded Evaluation Program, collaborating with Apollo Research, METR, Transluce, and Goodfire for independent third-party evaluations of model alignment, security safeguards, and monitoring systems.

Heat over time

Now
25
Peak
2617 Nov, 08:00
24h change
–

Hover or tap the chart to see each hour; use the arrow keys on a keyboard.