evaluation-task · Source-linked discovery

TruthfulQA: Measuring How Models Mimic Human Falsehoods

Measure whether a language model is truthful in generating answers to questions using questions that some humans would answer falsely due to a false belief or misconception.

Open interactive record →
OriginStephanie Lin, Jacob Hilton, Owain EvansTopicsEvaluation integrityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources