Title
Top-Rank Enhanced Listwise Optimization for Statistical Machine Translation.
Abstract
Pairwise ranking methods are the basis of many widely used discriminative training approaches for structure prediction problems in natural language processing(NLP). Decomposing the problem of ranking hypotheses into pairwise comparisons enables simple and efficient solutions. However, neglecting the global ordering of the hypothesis list may hinder learning. We propose a listwise learning framework for structure prediction problems such as machine translation. Our framework directly models the entire translation listu0027s ordering to learn parameters which may better fit the given listwise samples. Furthermore, we propose top-rank enhanced loss functions, which are more sensitive to ranking errors at higher positions. Experiments on a large-scale Chinese-English translation task show that both our listwise learning framework and top-rank enhanced listwise losses lead to significant improvements in translation quality.
Year
DOI
Venue
2017
10.18653/v1/K17-1011
CoNLL
DocType
Volume
Citations 
Conference
abs/1707.05438
0
PageRank 
References 
Authors
0.34
13
5
Name
Order
Citations
PageRank
Huadong Chen1322.82
Shujian Huang215828.78
David Chiang32843144.76
Xinyu Dai414132.87
Jiajun Chen524445.03