A-RSI model improves zero-shot multi-modal self-improvement performance
The story so far
A-RSI refreshes training tasks based on learning signals and uses independently verifiable programs to generate answers, improving benchmark test performance without external labels. The model monitors reward changes and accuracy in training logs to refresh the task pool and utilizes a static model self-programming library to generate multimodal questions and their reference answers, while automatically verifying the properties of rewards and refresh rules and auditing the generated answers. In eleven benchmark tests, A-RSI improved average performance from 57.77 to 61.05 with 800 new tasks.
AI-written from the reports · Updated 20 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face Daily PapersA-RSI: Adaptive Task Refresh for Zero-Data Multimodal Self-Improvement
A-RSI refreshes training tasks based on learning signal decline and uses independently verifiable programs to generate answers, enhancing benchmark test performance without external labels. The model monitors reward changes and accuracy in training logs to refresh the task pool and utilizes a static model self-programming library to generate multimodal questions and their reference answers, while automatically verifying the properties of reward and refresh rules and auditing the generated answers. In eleven benchmark tests, A-RSI increased average performance from 57.77 to 61.05 with 800 new tasks.