evaluation-task · Source-linked discovery

MATH: Measuring Mathematical Problem Solving

Dataset of 12,500 challenging competition mathematics problems. Demonstrates fewshot prompting and custom scorers. NOTE: The dataset has been taken down due to a DMCA notice from The Art of Problem Solving.

Open interactive record →
OriginDan Hendrycks, Collin Burns, Saurav Kadavath et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources