Skip to content
Live
Trending storyPast story

YANAMI dataset released

1 reports1 outlets15 days agoUpdate

The story so far

AI overview

YANAMI introduces a large-scale multimodal dialogue dataset and benchmark that requires models to track and implement evolving dialogue states across rounds, revealing that current unified multimodal models still struggle with this task. YANAMI-400K contains 400,000 multimodal dialogue rounds across 4 scenarios, requiring models to continuously track, store, and revise evolving multimodal dialogue states across rounds; YANAMI-Bench contains 400 multimodal rounds for system evaluation of multimodal state interaction, jointly evaluating dialogue state understanding and visual implementation.

AI-written from the reports · Updated 15 days ago

Coverage timeline

Follow the coverage to see every side of the story.

4 Nov
  1. Hugging Face Daily Papers
    YANAMI: A Large-Scale Multimodal Dataset and Benchmark for Multiturn Stateful Interaction

    YANAMI introduces a large-scale multimodal dialogue dataset and benchmark that requires models to track and implement evolving dialogue states across rounds, revealing that current unified multimodal models still struggle with this task. YANAMI-400K contains 400,000 multimodal dialogue rounds across 4 scenarios, requiring models to continuously track, store, and revise evolving multimodal dialogue states across rounds; YANAMI-Bench contains 400 multimodal rounds for system evaluation of multimodal state interaction, jointly evaluating dialogue state understanding and visual implementation.