Skip to content
Live
Trending storyPast story

A-RSI model improves zero-shot multi-modal self-improvement performance

1 reports1 outlets20 days agoUpdate

The story so far

AI overview

A-RSI refreshes training tasks based on learning signals and uses independently verifiable programs to generate answers, improving benchmark test performance without external labels. The model monitors reward changes and accuracy in training logs to refresh the task pool and utilizes a static model self-programming library to generate multimodal questions and their reference answers, while automatically verifying the properties of rewards and refresh rules and auditing the generated answers. In eleven benchmark tests, A-RSI improved average performance from 57.77 to 61.05 with 800 new tasks.

AI-written from the reports · Updated 20 days ago

Coverage timeline

Follow the coverage to see every side of the story.

30 Oct
  1. Hugging Face Daily Papers
    A-RSI: Adaptive Task Refresh for Zero-Data Multimodal Self-Improvement

    A-RSI refreshes training tasks based on learning signal decline and uses independently verifiable programs to generate answers, enhancing benchmark test performance without external labels. The model monitors reward changes and accuracy in training logs to refresh the task pool and utilizes a static model self-programming library to generate multimodal questions and their reference answers, while automatically verifying the properties of reward and refresh rules and auditing the generated answers. In eleven benchmark tests, A-RSI increased average performance from 57.77 to 61.05 with 800 new tasks.