Skip to content
Live
The Decoder· Matthias Bastian·· 6 hours ago

Anthropic can already retrain Mythos with "a fraction of the compute originally needed," says former researcher Coxon

Anthropic can already retrain Mythos with "a fraction of the compute originally needed," says former researcher Coxon

Brief overview

Former Anthropic and OpenAI researcher Jacob Coxon said the IPO roadshow slides for Anthropic were the main reason for his departure, as they showed that after a major leap in capabilities for its Mythos model in the spring, it could be retrained using 'a small portion of the original computing resources,' indicating that algorithm efficiency was accelerating.

Same story1 other outlet also reported this

  1. The Decoder··First·Reading now

    Former Anthropic researcher Coxon: Anthropic can now retrain the Mythos model using 'a small portion of the original computing resources'

  2. ITHome · AI··+24 min

    Former Anthropic researcher Jacob Cowen: To retrain Mythos, only a small part of the initial computing power is needed

In order of publication · later reports are added as they appear

Article

Jacob Coxon, former OpenAI and Anthropic researcher who brought AI fears into the mainstream, says a slide from Anthropic's IPO roadshow was a major reason he quit.

Coxon says a slide Anthropic released for its IPO roadshow was a key reason he left the company after only about four months. The chart shows how much compute Anthropic needs over time to train its models, and the axis is compressed so that a 10x and a 100x increase barely look different.

Yet the curve still climbs steeply, which Coxon says shows that algorithmic efficiency is improving not just quickly but at an accelerating rate. "It's an insane plot and I'm surprised they made it public," he writes.

Coxon argues that Anthropic's Mythos model, a major capability jump in the spring, was part of this accelerating trend. "Mythos was not a one-time deviation, but a point on a superexponential. They could already retrain Mythos with a fraction of the compute originally needed," he writes.

This slide from Anthropic's IPO roadshow shows the "Pre-training compute multiplier" for code over time. The y-axis is logarithmic. Former Anthropic researcher Jacob Coxon says the steep climb from July 2024 to October 2026 points to superexponential algorithmic progress. Anthropic notes that the data points are based on internal estimates and are for illustration only. | Image: Anthropic

He says algorithmic improvements are "on the verge of being automated," which is why he wants frontier model development paused next year so competitors can catch up. A pause, he writes, would "commoditize human-level intelligence. It would only harm OpenAI and Anthropic."

Coxon previously trained AI models at OpenAI and, most recently, Anthropic. He drew wide attention in September with public warnings about the risks of advanced AI systems, echoed by other protagonists in the industry. One of their fears is that advanced, self-improving AI could get out of control.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Source: The Decoder · the-decoder.com