YANAMI dataset released
The story so far
YANAMI introduces a large-scale multimodal dialogue dataset and benchmark that requires models to track and implement evolving dialogue states across rounds, revealing that current unified multimodal models still struggle with this task. YANAMI-400K contains 400,000 multimodal dialogue rounds across 4 scenarios, requiring models to continuously track, store, and revise evolving multimodal dialogue states across rounds; YANAMI-Bench contains 400 multimodal rounds for system evaluation of multimodal state interaction, jointly evaluating dialogue state understanding and visual implementation.
AI-written from the reports · Updated 15 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face Daily PapersYANAMI: A Large-Scale Multimodal Dataset and Benchmark for Multiturn Stateful Interaction
YANAMI introduces a large-scale multimodal dialogue dataset and benchmark that requires models to track and implement evolving dialogue states across rounds, revealing that current unified multimodal models still struggle with this task. YANAMI-400K contains 400,000 multimodal dialogue rounds across 4 scenarios, requiring models to continuously track, store, and revise evolving multimodal dialogue states across rounds; YANAMI-Bench contains 400 multimodal rounds for system evaluation of multimodal state interaction, jointly evaluating dialogue state understanding and visual implementation.