Title
BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms
Abstract
In this paper we present a speech-to-speech (S2S) translation system called the BBN TransTalk that enables two-way communication between speakers of English and speakers who do not understand or speak English. The BBN TransTalk has been configured for several languages including Iraqi Arabic, Pashto, Dari, Farsi, Malay, Indonesian, and Levantine Arabic. We describe the key components of our system: automatic speech recognition (ASR), machine translation (MT), text-to-speech (TTS), dialog manager, and the user interface (UI). In addition, we present novel techniques for overcoming specific challenges in developing high-performing S2S systems. For ASR, we present techniques for dealing with lack of pronunciation and linguistic resources and effective modeling of ambiguity in pronunciations of words in these languages. For MT, we describe techniques for dealing with data sparsity as well as modeling context. We also present and compare different user confirmation techniques for detecting errors that can cause the dialog to drift or stall.
Year
DOI
Venue
2013
10.1016/j.csl.2011.10.003
Computer Speech & Language
Keywords
Field
DocType
robust multilingual two-way speech-to-speech,different user confirmation technique,s2s system,levantine arabic,mobile platform,iraqi arabic,present technique,effective modeling,machine translation,present novel technique,bbn transtalk,dialog manager,automatic speech recognition
Pronunciation,Dialog box,Malay,Computer science,Machine translation,Speech recognition,Artificial intelligence,Natural language processing,Pashto,User interface,Indonesian,Ambiguity
Journal
Volume
Issue
ISSN
27
2
0885-2308
Citations 
PageRank 
References 
1
0.41
15
Authors
13
Name
Order
Citations
PageRank
Rohit Prasad146539.06
Premkumar Natarajan287479.46
David Stallard315359.87
Shirin Saleem4786.61
Shankar Ananthakrishnan521.81
Stavros Tsakalidis621313.83
Chia-Lin Kao7384.02
F. Choi8153.80
Ralf Meermeier930.81
Mark Rawls1010.41
Jacob Devlin1173832.34
K. Krstovski12286.24
Aaron Challenner1371.16