Paper Info
Title
Combining Augmented Reality and Speech Technologies to Help Deaf and Hard of Hearing People
Abstract
Augmented Reality (AR), Automatic Speech Recognition (ASR) and Text-to-Speech Synthesis (TTS) can be used to help people with disabilities. In this paper, we combine these technologies to make a new system for helping deaf people. This system can take the narrator's speech and convert it into a readable text and show it directly on AR display. To improve the accuracy of the system, we use Audio-Visual Speech Recognition (AVSR) as a backup for the ASR engine in noisy environments. In addition, we use the TTS system to make our system more usable for deaf people. The results of testing the system show that its accuracy is over 85 percent on average in different places. Also, the result of a survey shows that more than 90 percent of deaf people on average are very interested in using our system as an assistant in portable devices for communication.
Year
DOI
Venue
2012
10.1109/SVR.2012.10
Virtual and Augmented Reality
Keywords
Field
DocType
speech technologies,system show,hearing people,tts system,asr engine,text-to-speech synthesis,deaf people,automatic speech recognition,audio-visual speech recognition,augmented reality,ar display,new system,speech,speech technology,engines,speech synthesis,speech recognition,switches,testing,hardware
Speech corpus,Speech processing,Speech synthesis,Speech analytics,Voice activity detection,Computer science,Cued speech,Speech recognition,Audio-visual speech recognition,Speech technology
Conference
ISBN
Citations 
PageRank 
978-1-4673-1929-4
4
0.44
References 
Authors
6
3
Name
Order
Citations
PageRank
Mohammad Reza Mirzaei1151.39
Seyed Ghorshi2175.17
Mohammad Mortazavi3366.28