Abstract | ||
---|---|---|
The first attention-based neural-MT for multi-way, multilingual translation is proposed.Multi-way multilingual model is tested on more than 8 languages (En, Fr, Cz, De, Ru, Fi, Tr and Uz).It achieves the translation quality comparable to single-pair NMTs with less parameters.Single attention mechanism supports to align between multiple pairs and directions.Outperforms conventional SMT system on low-resource translation tasks. We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of languages. This is made possible by having a single attention mechanism that is shared across all language pairs. We train the proposed multi-way, multilingual model on ten language pairs from WMT15 simultaneously and observe clear performance improvements over models trained on only one language pair. We empirically evaluate the proposed model on low-resource language translation tasks. In particular, we observe that the proposed multilingual model outperforms strong conventional statistical machine translation systems on Turkish-English and Uzbek-English by incorporating the resources of other language pairs. |
Year | DOI | Venue |
---|---|---|
2017 | 10.1016/j.csl.2016.10.006 | Computer Speech & Language |
Keywords | Field | DocType |
Neural machine translation,Multi-lingual,Low resource translation | Rule-based machine translation,Example-based machine translation,Language translation,Computer science,Machine translation,Speech recognition,Synchronous context-free grammar,Machine translation software usability,Artificial intelligence,Natural language processing,Transfer-based machine translation,Computer-assisted translation | Journal |
Volume | Issue | ISSN |
45 | C | 0885-2308 |
Citations | PageRank | References |
7 | 0.56 | 24 |
Authors | ||
5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Orhan Firat | 1 | 281 | 29.13 |
Kyunghyun Cho | 2 | 6803 | 316.85 |
Baskaran Sankaran | 3 | 155 | 13.65 |
Fatos T. Yarman-Vural | 4 | 287 | 27.11 |
Yoshua Bengio | 5 | 42677 | 3039.83 |