Name
Title | ||
|---|---|---|
Automatic visual speech segmentation and recognition using directional motion history images and Zernike moments |
Abstract | ||
|---|---|---|
Appearance-based visual speech recognition using only video signals is presented. The proposed technique is based on the use of directional motion history images (DMHIs), which is an extension of the popular optical-flow method for object tracking. Zernike moments of each DMHI are computed in order to perform the classification. The technique incorporates automatic temporal segmentation of isolated utterances. The segmentation of isolated utterance is achieved using pair-wise pixel comparison. Support vector machine is used for classification and the results are based on leave-one-out paradigm. Experimental results show that the proposed technique achieves better performance in visemes recognition than others reported in literature. The benefit of this proposed visual speech recognition method is that it is suitable for real-time applications due to quick motion tracking system and the fast classification method employed. It has applications in command and control using lip movement to text conversion and can be used in noisy environment and also for assisting speech impaired persons. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1007/s00371-012-0751-7 | The Visual Computer |
Keywords | Field | DocType |
directional motion history image,object tracking,fast classification method,automatic visual speech segmentation,zernike moment,popular optical-flow method,visemes recognition,proposed technique,appearance-based visual speech recognition,isolated utterance,automatic temporal segmentation,proposed visual speech recognition,optical flow | Computer vision,Pattern recognition,Viseme,Computer science,Segmentation,Video tracking,Artificial intelligence,Motion analysis,Speech segmentation,Optical flow,Motion History Images,Match moving | Journal |
Volume | Issue | ISSN |
29 | 10 | 1432-2315 |
Citations | PageRank | References |
3 | 0.37 | 34 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ayaz A. Shaikh | 1 | 8 | 0.83 |
| Dinesh K. Kumar | 2 | 83 | 9.17 |
| Jayavardhana Gubbi | 3 | 2157 | 106.17 |