evaluation-task · Source-linked discovery
MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
A comprehensive dataset designed to evaluate Large Vision-Language Models (LVLMs) across a wide range of multi-image tasks. The dataset encompasses 7 types of multi-image relationships, 52 tasks, 77K images, and 11K meticulously curated multiple-choice questions.
OriginFanqing Meng, Jin Wang, Chuanhao Li et al.TopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.