evaluation-task · Source-linked discovery
SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
A benchmark of freelance software engineering tasks from Upwork, valued at $1 million USD total in realworld payouts.
OriginSamuel Miserendino, Michele Wang, Tejal Patwardhan et al.TopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.