Title
Effective Selection Of Translation Model Training Data
Abstract
Data selection has been demonstrated to be an effective approach to addressing the lack of high-quality bitext for statistical machine translation in the domain of interest. Most current data selection methods solely use language models trained on a small scale in-domain data to select domain-relevant sentence pairs from general-domain parallel corpus. By contrast, we argue that the relevance between a sentence pair and target domain can be better evaluated by the combination of language model and translation model. In this paper, we study and experiment with novel methods that apply translation models into domain-relevant data selection. The results show that our methods outperform previous methods. When the selected sentence pairs are evaluated on an end-to-end MT task, our methods can increase the translation performance by 3 BLEU points.
Year
Venue
Field
2014
PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2
Rule-based machine translation,BLEU,Data selection,Evaluation of machine translation,Computer science,Machine translation,Artificial intelligence,Natural language processing,Language model,Training set,Speech recognition,Sentence,Machine learning
DocType
Volume
Citations 
Conference
P14-2
5
PageRank 
References 
Authors
0.40
15
5
Name
Order
Citations
PageRank
Le Liu1308.45
Yu Hong224635.44
Hao Liu350.40
Xing Wang45810.07
Jianmin Yao513116.96