Paper Info
Title
Using augmented reality and automatic speech recognition techniques to help deaf and hard of hearing people
Abstract
Recently, many researches show Augmented Reality (AR) and Automatic Speech Recognition (ASR) can help people with disabilities. In this paper we implement an innovative system for helping deaf people by combining AR, ASR, and AVSR technologies. This system can instantly take narrator's speech and converts it into readable text and shows it directly on AR display. We show that our system's accuracy becomes over 85 percent on average, by using different ASR engines near using an AVSR engine in different noisy environments. We also show in a survey that more than 90 percent of deaf people on average need such system as assistant in portable devices, near using only text or only sign-language for communications.
Year
DOI
Venue
2012
10.1145/2331714.2331720
VRIC
Keywords
Field
DocType
avsr engine,augmented reality,readable text,hearing people,deaf people,different noisy environment,ar display,automatic speech recognition technique,innovative system,automatic speech recognition,avsr technology,different asr engine,communication,sign language
Computer science,Augmented reality,Speech recognition,Audio-visual speech recognition
Conference
Citations 
PageRank 
References 
5
0.50
2
Authors
3
Name
Order
Citations
PageRank
Mohammad Reza Mirzaei1151.39
Seyed Ghorshi2175.17
Mohammad Mortazavi3366.28