evaluation-task · Source-linked discovery

BBH: Challenging BIG-Bench Tasks

Tests AI models on a suite of 23 challenging BIG-Bench tasks that previously proved difficult even for advanced language models to solve.

Open interactive record →
OriginMirac Suzgun, Nathan Scales, Nathanael Schärli et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources