Title | ||
---|---|---|
Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction |
Abstract | ||
---|---|---|
Computeranimatedagents and robots bring a social dimen- sion to human computer interaction and force us to think in new ways about how computers could be used in daily life. Face to face communication is a real-time process operat- ing at a a time scale in the order of 40 milliseconds. The level of uncertainty at this time scale is considerable, mak- ing it necessary for humansand machines to rely on sensory rich perceptual primitives rather than slow symbolic infer- ence processes. In this paper we present progress on one such perceptual primitive. The system automatically de- tects frontal faces in the video stream and codes them with respect to 7 dimensions in real time: neutral, anger, dis- gust, fear, joy, sadness, surprise. The face finder employs a cascade of feature detectors trained with boosting tech- niques (16, 3). The expression recognizer receives image patches located by the face detector. A Gabor representa- tion of the patch is formed and then processed by a bank of SVM classifiers. A novel combination of Adaboost and SVM's enhances performance. The system was tested on the Cohn-Kanade dataset of posed facial expressions (7). The generalization performance to new subjects for a 7- way forced choice correct. Most interestingly the outputs of the classifier change smoothly as a function of time, pro- viding a potentially valuable representation to code facial expression dynamics in a fully automatic and unobtrusive manner. The system has been deployed on a wide variety of platforms including Sony's Aibo pet robot, ATR's RoboVie, and CU animator, and is currently being evaluated for ap- plications including automatic reading tutors, assessment of human-robot interaction. |
Year | DOI | Venue |
---|---|---|
2003 | 10.1109/CVPRW.2003.10057 | CVPR Workshops |
DocType | Volume | Issue |
Conference | 5 | 1 |
ISSN | ISBN | Citations |
1063-6919 | 0-7695-1900-8 | 184 |
PageRank | References | Authors |
10.48 | 9 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Marian Stewart Bartlett | 1 | 2026 | 183.92 |
gwen littlewort | 2 | 1159 | 67.40 |
Ian R. Fasel | 3 | 656 | 40.60 |
Javier R. Movellan | 4 | 1853 | 150.44 |