evaluation-task · Source-linked discovery

HellaSwag: Commonsense Event Continuation

Tests models' commonsense reasoning abilities by asking them to select the most likely next step or continuation for a given everyday situation.

Open interactive record →
OriginRowan Zellers, Ari Holtzman, Yonatan Bisk et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources