evaluation-family · Source-linked discovery

Simpleqa

A benchmark that evaluates the ability of language models to answer short, fact-seeking questions.

Open interactive record →
OriginLukas Haas, Gal Yona, Giovanni D'Antonio et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources