Title
Enhanced Sign Language Transcription System via Hand Tracking and Pose Estimation.
Abstract
In this study, we propose a new system for constructing parallel corpora for sign languages, which are generally under-resourced in comparison to spoken languages. In order to achieve scalability and accessibility regarding data collection and corpus construction, our system utilizes deep learning-based techniques and predicts depth information to perform pose estimation on hand information obtainable from video recordings by a single RGB camera. These estimated poses are then transcribed into expressions in SignWriting. We evaluate the accuracy of hand tracking and hand pose estimation modules of our system quantitatively, using the American Sign Language Image Dataset and the American Sign Language Lexicon Video Dataset. The evaluation results show that our transcription system has a high potential to be successfully employed in constructing a sizable sign language corpus using various types of video resources.
Year
Venue
Field
2016
JCSE
Expression (mathematics),Computer science,Pose,Speech recognition,Sign language,Lexicon,American Sign Language,Artificial intelligence,RGB color model,SignWriting,Deep learning
DocType
Volume
Issue
Journal
10
3
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Jung-Ho Kim12011.48
Najoung Kim242.44
Hancheol Park382.63
Jong C. Park442044.73