evaluation-task · Source-linked discovery

WorldSense: Grounded Reasoning Benchmark

Measures grounded reasoning over synthetic world descriptions while controlling for dataset bias. Includes three problem types (Infer, Compl, Consist) and two grades (trivial, normal).

Open interactive record →
OriginYoussef Benchekroun, Megi Dervishi, Mark Ibrahim et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources