Abstract | ||
---|---|---|
This paper studies the impact of paraphrases on the accuracy of automatic evaluation. Given a reference sentence and a machine-generated sentence, we seek to find a paraphrase of the reference sentence that is closer in wording to the machine output than the original reference. We apply our paraphrasing method in the context of machine translation evaluation. Our experiments show that the use of a paraphrased synthetic reference refines the accuracy of automatic evaluation. We also found a strong connection between the quality of automatic paraphrases as judged by humans and their contribution to automatic evaluation. |
Year | DOI | Venue |
---|---|---|
2006 | 10.3115/1220835.1220893 | HLT-NAACL |
Keywords | Field | DocType |
original reference,machine output,machine translation evaluation,reference sentence,automatic evaluation,paper study,automatic paraphrase,machine-generated sentence,paraphrasing method,paraphrased synthetic reference,machine translation | Computer science,Machine translation,Paraphrase,Speech recognition,Natural language processing,Artificial intelligence,Sentence | Conference |
Citations | PageRank | References |
79 | 3.42 | 18 |
Authors | ||
2 |
Name | Order | Citations | PageRank |
---|---|---|---|
David Kauchak | 1 | 363 | 25.92 |
Regina Barzilay | 2 | 3869 | 254.27 |