Title
Large-Vocabulary Continuous Sign Language Recognition Based on Transition-Movement Models
Abstract
The major challenges that sign language recognition (SLR) now faces are developing methods that solve large-vocabulary continuous sign problems. In this paper, transition-movement models (TMMs) are proposed to handle transition parts between two adjacent signs in large-vocabulary continuous SLR. For tackling mass transition movements arisen from a large vocabulary size, a temporal clustering algorithm improved from k-means by using dynamic time warping as its distance measure is proposed to dynamically cluster them; then, an iterative segmentation algorithm for automatically segmenting transition parts from continuous sentences and training these TMMs through a bootstrap process is presented. The clustered TMMs due to their excellent generalization are very suitable for large-vocabulary continuous SLR. Lastly, TMMs together with sign models are viewed as candidates of the Viterbi search algorithm for recognizing continuous sign language. Experiments demonstrate that continuous SLR based on TMMs has good performance over a large vocabulary of 5113 Chinese signs and obtains an average accuracy of 91.9%
Year
DOI
Venue
2007
10.1109/TSMCA.2006.886347
IEEE Transactions on Systems, Man, and Cybernetics, Part A
Keywords
Field
DocType
hidden markov model (hmm),dynamic time warping (dtw),transition-movement models,pattern clustering,continuous sign language,adjacent sign,large-vocabulary continuous slr,continuous slr,temporal clustering algorithm,bootstrap process,chinese sign,large-vocabulary continuous sign language,large-vocabulary continuous sign problem,viterbi search algorithm,iterative segmentation algorithm,sign language recognition (slr),chinese sign language (csl),dynamic time warping,sign model,gesture recognition,continuous sentence,sign language recognition,transition part,chinese sign language,sign language,k means,indexing terms,hidden markov model,search algorithm
Chinese Sign Language,Dynamic time warping,Computer science,Gesture recognition,Artificial intelligence,Cluster analysis,Bootstrapping (electronics),Pattern recognition,Segmentation,Speech recognition,Sign language,Vocabulary,Machine learning
Journal
Volume
Issue
ISSN
37
1
1083-4427
Citations 
PageRank 
References 
48
1.93
21
Authors
3
Name
Order
Citations
PageRank
G. Fang1481.93
Wen Gao211374741.77
Debin Zhao33010206.12