evaluation-task · Source-linked discovery
WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale
Set of 273 expert-crafted pronoun resolution problems originally designed to be unsolvable for statistical models that rely on selectional preferences or word associations.
OriginKeisuke Sakaguchi, Ronan Le Bras, Chandra Bhagavatula et al.TopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.