evaluation-task · Source-linked discovery
DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation
Code generation benchmark with a thousand data science problems spanning seven Python libraries.
OriginYuhang Lai, Chengxi Li, Yiming Wang et al.TopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.