VisSearch-Bench released
The story so far
VisSearch-Bench has been released, evaluating the performance of 16 multimodal models on 204 human-written visual search tasks that require integrating visual context with external information. The results show that the best system only fully solved 26.47% of the tasks. The benchmark covers seven main areas, including set-based visual search and sequential visual search, and evaluates task completion and the correctness of reasoning steps through accuracy and process scores.
AI-written from the reports · Updated 11 days ago
Coverage timeline
Follow the coverage to see every side of the story.
- Hugging Face Daily PapersVisSearch-Bench: Evaluating Long Horizon Visual Search in Multimodal Agents
VisSearch-Bench evaluated the performance of 16 multimodal models on 204 human-written visual search tasks that require integrating visual context with external information, with the results showing that the best system only fully solved 26.47% of the tasks. The benchmark covers 7 major areas, including set-based visual search and sequential visual search, and evaluates task completion and the correctness of reasoning steps through accuracy and process scoring.