Name
Abstract | ||
|---|---|---|
In this paper we present a novel user interface that integrates two popular approaches to language translation for travelers allowing multimodal communication between the parties involved: the picture-book, in which the user simply points to multiple picture icons representing what they want to say, and the statistical machine translation (SMT) system that can translate arbitrary word sequences. Our prototype system tightly couples both processes within a translation framework that inherits many of the the positive features of both approaches, while at the same time mitigating their main weaknesses. Our system differs from traditional approaches in that its mode of input is a sequence of pictures, rather than text or speech. Text in the source language is generated automatically, and is used as a detailed representation of the intended meaning. The picture sequence which not only provides a rapid method to communicate basic concepts but also gives a 'second opinion' on the machine transition output that catches machine translation errors and allows the users to retry the translation, avoiding misunderstandings. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.5591/978-1-57735-516-8/IJCAI11-435 | IJCAI |
Keywords | Field | DocType |
multiple picture,translation framework,statistical machine translation,picture sequence,novel user interface,prototype system,language translation,mobile device,arbitrary word sequence,catches machine translation error,machine transition output | Rule-based machine translation,Example-based machine translation,Language translation,Computer science,Machine translation,Synchronous context-free grammar,Transfer-based machine translation,Natural language processing,Artificial intelligence,Computer-assisted translation,User interface,Machine learning | Conference |
Citations | PageRank | References |
4 | 0.48 | 9 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Andrew Finch | 1 | 144 | 19.05 |
| Wei Song | 2 | 4 | 0.48 |
| Kumiko Tanaka-Ishii | 3 | 261 | 36.69 |
| Eiichiro SUMITA | 4 | 1466 | 190.87 |