evaluation-task · Source-linked discovery

PIQA: Physical Commonsense Reasoning Test

Measures the model's ability to apply practical, everyday commonsense reasoning about physical objects and scenarios through simple decision-making questions.

Open interactive record →
OriginYonatan Bisk, Rowan Zellers, Ronan Le Bras et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources