evaluation-task · Source-linked discovery
NoveltyBench: Evaluating Language Models for Humanlike Diversity
Evaluates how well language models generate diverse, humanlike responses across multiple reasoning and generation tasks. This evaluation assesses whether LLMs can produce varied outputs rather than repetitive or uniform answers.
OriginYiming Zhang, Harshita Diddee, Susan Holm et al.TopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.