Title | ||
---|---|---|
BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms |
Abstract | ||
---|---|---|
In this paper we present a speech-to-speech (S2S) translation system called the BBN TransTalk that enables two-way communication between speakers of English and speakers who do not understand or speak English. The BBN TransTalk has been configured for several languages including Iraqi Arabic, Pashto, Dari, Farsi, Malay, Indonesian, and Levantine Arabic. We describe the key components of our system: automatic speech recognition (ASR), machine translation (MT), text-to-speech (TTS), dialog manager, and the user interface (UI). In addition, we present novel techniques for overcoming specific challenges in developing high-performing S2S systems. For ASR, we present techniques for dealing with lack of pronunciation and linguistic resources and effective modeling of ambiguity in pronunciations of words in these languages. For MT, we describe techniques for dealing with data sparsity as well as modeling context. We also present and compare different user confirmation techniques for detecting errors that can cause the dialog to drift or stall. |
Year | DOI | Venue |
---|---|---|
2013 | 10.1016/j.csl.2011.10.003 | Computer Speech & Language |
Keywords | Field | DocType |
robust multilingual two-way speech-to-speech,different user confirmation technique,s2s system,levantine arabic,mobile platform,iraqi arabic,present technique,effective modeling,machine translation,present novel technique,bbn transtalk,dialog manager,automatic speech recognition | Pronunciation,Dialog box,Malay,Computer science,Machine translation,Speech recognition,Artificial intelligence,Natural language processing,Pashto,User interface,Indonesian,Ambiguity | Journal |
Volume | Issue | ISSN |
27 | 2 | 0885-2308 |
Citations | PageRank | References |
1 | 0.41 | 15 |
Authors | ||
13 |
Name | Order | Citations | PageRank |
---|---|---|---|
Rohit Prasad | 1 | 465 | 39.06 |
Premkumar Natarajan | 2 | 874 | 79.46 |
David Stallard | 3 | 153 | 59.87 |
Shirin Saleem | 4 | 78 | 6.61 |
Shankar Ananthakrishnan | 5 | 2 | 1.81 |
Stavros Tsakalidis | 6 | 213 | 13.83 |
Chia-Lin Kao | 7 | 38 | 4.02 |
F. Choi | 8 | 15 | 3.80 |
Ralf Meermeier | 9 | 3 | 0.81 |
Mark Rawls | 10 | 1 | 0.41 |
Jacob Devlin | 11 | 738 | 32.34 |
K. Krstovski | 12 | 28 | 6.24 |
Aaron Challenner | 13 | 7 | 1.16 |