evaluation-task · Source-linked discovery
PAWS: Paraphrase Adversaries from Word Scrambling
Evaluating models on the task of paraphrase detection by providing pairs of sentences that are either paraphrases or not.
OriginYuan Zhang, Jason Baldridge, Luheng HeTopicsGeneral capabilityStatusimported
Can support
Not independently assessed by FronteraEval yet.
Cannot support by itself
No inference beyond the upstream source should be made until the protocol is reviewed.