Title
Multi-way, multilingual neural machine translation.
Abstract
The first attention-based neural-MT for multi-way, multilingual translation is proposed.Multi-way multilingual model is tested on more than 8 languages (En, Fr, Cz, De, Ru, Fi, Tr and Uz).It achieves the translation quality comparable to single-pair NMTs with less parameters.Single attention mechanism supports to align between multiple pairs and directions.Outperforms conventional SMT system on low-resource translation tasks. We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of languages. This is made possible by having a single attention mechanism that is shared across all language pairs. We train the proposed multi-way, multilingual model on ten language pairs from WMT15 simultaneously and observe clear performance improvements over models trained on only one language pair. We empirically evaluate the proposed model on low-resource language translation tasks. In particular, we observe that the proposed multilingual model outperforms strong conventional statistical machine translation systems on Turkish-English and Uzbek-English by incorporating the resources of other language pairs.
Year
DOI
Venue
2017
10.1016/j.csl.2016.10.006
Computer Speech & Language
Keywords
Field
DocType
Neural machine translation,Multi-lingual,Low resource translation
Rule-based machine translation,Example-based machine translation,Language translation,Computer science,Machine translation,Speech recognition,Synchronous context-free grammar,Machine translation software usability,Artificial intelligence,Natural language processing,Transfer-based machine translation,Computer-assisted translation
Journal
Volume
Issue
ISSN
45
C
0885-2308
Citations 
PageRank 
References 
7
0.56
24
Authors
5
Name
Order
Citations
PageRank
Orhan Firat128129.13
Kyunghyun Cho26803316.85
Baskaran Sankaran315513.65
Fatos T. Yarman-Vural428727.11
Yoshua Bengio5426773039.83