evaluation-family · Source-linked discovery

Mmmu Multiple Choice

Assesses multimodal AI models on challenging college-level questions covering multiple academic subjects, requiring detailed visual interpretation, in-depth reasoning, and both multiple-choice and open-ended answering abilities.

Open interactive record →
OriginXiang Yue, Yuansheng Ni, Kai Zhang et al.TopicsMultimodalStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources