Title
Paraphrasing for automatic evaluation
Abstract
This paper studies the impact of paraphrases on the accuracy of automatic evaluation. Given a reference sentence and a machine-generated sentence, we seek to find a paraphrase of the reference sentence that is closer in wording to the machine output than the original reference. We apply our paraphrasing method in the context of machine translation evaluation. Our experiments show that the use of a paraphrased synthetic reference refines the accuracy of automatic evaluation. We also found a strong connection between the quality of automatic paraphrases as judged by humans and their contribution to automatic evaluation.
Year
DOI
Venue
2006
10.3115/1220835.1220893
HLT-NAACL
Keywords
Field
DocType
original reference,machine output,machine translation evaluation,reference sentence,automatic evaluation,paper study,automatic paraphrase,machine-generated sentence,paraphrasing method,paraphrased synthetic reference,machine translation
Computer science,Machine translation,Paraphrase,Speech recognition,Natural language processing,Artificial intelligence,Sentence
Conference
Citations 
PageRank 
References 
79
3.42
18
Authors
2
Name
Order
Citations
PageRank
David Kauchak136325.92
Regina Barzilay23869254.27