Skip to content
Live
Trending storyPast story

New model release improves reasoning performance

1 reports1 outlets16 days agoUpdate

The story so far

AI overview

Order-Only On-Policy Distillation (O^{3}PD) is released, training student models to match the token ordering of the teacher model rather than probabilities, averaging 2.9 points better than OPD on HMMT25, AIME24, and AIME25, with a 5.6-point improvement on AIME25. This technology does not require temperature tuning and is not affected by the teacher model's temperature.

AI-written from the reports · Updated 15 days ago

Coverage timeline

Follow the coverage to see every side of the story.

3 Nov
  1. Hugging Face Daily Papers
    Order-Only On-Policy Distillation

    Order-Only On-Policy Distillation (O^{3}PD) trains student models to match the token ordering of the teacher model rather than probabilities, averaging 2.9 points better than OPD on HMMT25, AIME24, and AIME25, with a 5.6 point improvement on AIME25. This technique requires no temperature tuning and is unaffected by the teacher model's temperature.