evaluation-task · Source-linked discovery
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Python coding benchmark with 1,140 diverse questions drawing on numerous python libraries.
OriginTerry Yue Zhuo, Minh Chien Vu, Jenny Chim et al.TopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.