evaluation-task · Source-linked discovery

Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities

A benchmark for evaluating the capabilities of LLM agents in cyber offense.

Open interactive record →
OriginAndrey Anurin, Jonathan Ng, Kibo Schaffer et al.TopicsGeneral capabilityStatusimported

Can support

Not independently assessed by FronteraEval yet.

Cannot support by itself

No inference beyond the upstream source should be made until the protocol is reviewed.

Original sources