evaluation-task · Source-linked discovery
LiveBench: A Challenging, Contamination-Free LLM Benchmark
LiveBench is a benchmark designed with test set contamination and objective evaluation in mind by releasing new questions regularly, as well as having questions based on recently-released datasets. Each question has verifiable, objective ground-truth answers, allowing hard questions to be scored accurately and automatically, without the use of an LLM judge.
OriginColin White, Samuel Dooley, Manley Roberts et al.TopicsEvaluation integrityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.