Name
Abstract | ||
|---|---|---|
Interactive machine translation (IMT) is an increasingly popular paradigm for semi-automated machine translation, where a human expert is integrated into the core of an automatic machine translation system. The human expert interacts with the IMT system by partially correcting the errors of the system's output. Then, the system proposes a new solution. This process is repeated until the output meets the desired quality. In this scenario, the interaction is typically performed using the keyboard and the mouse. However, speech is also a very interesting input modality since the user does not need to abandon the keyboard to interact with it. In this work, we present a new approach to perform speech interaction in a way that translation and speech inputs are tightly fused. This integration is performed early in the speech recognition step. Thus, the information from the translation models allows the speech recognition system to recover from errors that otherwise would be impossible to amend. In addition, this technique allows to use currently available speech recognition technology. The proposed system achieves an important boost in performance with respect to previous approaches. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1145/2070481.2070504 | ICMI |
Keywords | Field | DocType |
multimodal interactive machine translation,automatic machine translation system,semi-automated machine translation,speech recognition step,speech input,speech recognition system,available speech recognition technology,speech interaction,proposed system,imt system,interactive machine translation,automatic speech recognition,multimodal interaction,machine translation,speech recognition | Computer science,Machine translation,Speech interaction,Human–computer interaction,Artificial intelligence,Computer vision,Multimodality,Speech analytics,Voice activity detection,Audio mining,Machine translation system,Interactive machine translation,Speech recognition | Conference |
Citations | PageRank | References |
5 | 0.39 | 21 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Vicent Alabau | 1 | 90 | 12.21 |
| Luis Rodríguez-Ruiz | 2 | 8 | 2.89 |
| Alberto Sanchis | 3 | 73 | 7.67 |
| Pascual Martínez-Gómez | 4 | 61 | 7.36 |
| francisco casacuberta | 5 | 1439 | 161.33 |