Paper Info
Title
The Significance Of Facial Features For Automatic Sign Language Recognition
Abstract
Although facial features are considered to be essential for humans to understand sign language, no prior research work has yet examined their significance for automatic sign language recognition or presented some evaluation results. This paper describes a vision-based recognition system that employs both manual and facial features, extracted from the same input image. For facial feature extraction an active appearance model is applied to identify areas of interest such as the eyes and mouth region. Afterwards a numerical description of facial expression and lip outline is computed An extensive evaluation was performed on a new sign language corpus, which contains continuous articulations of 25 native signers. The obtained results proved the importance of integrating facial expressions into the classification process. The recognition rates for isolated and continuous signing increased in signer-dependent as well as in signer-independent operation mode. Interestingly, roughly two of ten signs were recognized just from the facial features.
Year
DOI
Venue
2008
10.1109/AFGR.2008.4813472
2008 8TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2008), VOLS 1 AND 2
Keywords
Field
DocType
face recognition,feature extraction,active appearance model,sign language,image classification,computer vision,shape,face,gesture recognition,facial expression
Facial recognition system,Facial Action Coding System,Computer science,Gesture recognition,Speech recognition,Feature extraction,Active appearance model,Sign language,Facial expression,Contextual image classification
Conference
ISSN
Citations 
PageRank 
2326-5396
8
0.62
References 
Authors
7
3
Name
Order
Citations
PageRank
Ulrich von Agris1773.68
Moritz Knorr2131.07
Karl-Friedrich Kraiss329427.33