Title
Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction
Abstract
Computeranimatedagents and robots bring a social dimen- sion to human computer interaction and force us to think in new ways about how computers could be used in daily life. Face to face communication is a real-time process operat- ing at a a time scale in the order of 40 milliseconds. The level of uncertainty at this time scale is considerable, mak- ing it necessary for humansand machines to rely on sensory rich perceptual primitives rather than slow symbolic infer- ence processes. In this paper we present progress on one such perceptual primitive. The system automatically de- tects frontal faces in the video stream and codes them with respect to 7 dimensions in real time: neutral, anger, dis- gust, fear, joy, sadness, surprise. The face finder employs a cascade of feature detectors trained with boosting tech- niques (16, 3). The expression recognizer receives image patches located by the face detector. A Gabor representa- tion of the patch is formed and then processed by a bank of SVM classifiers. A novel combination of Adaboost and SVM's enhances performance. The system was tested on the Cohn-Kanade dataset of posed facial expressions (7). The generalization performance to new subjects for a 7- way forced choice correct. Most interestingly the outputs of the classifier change smoothly as a function of time, pro- viding a potentially valuable representation to code facial expression dynamics in a fully automatic and unobtrusive manner. The system has been deployed on a wide variety of platforms including Sony's Aibo pet robot, ATR's RoboVie, and CU animator, and is currently being evaluated for ap- plications including automatic reading tutors, assessment of human-robot interaction.
Year
DOI
Venue
2003
10.1109/CVPRW.2003.10057
CVPR Workshops
DocType
Volume
Issue
Conference
5
1
ISSN
ISBN
Citations 
1063-6919
0-7695-1900-8
184
PageRank 
References 
Authors
10.48
9
4
Search Limit
100184
Name
Order
Citations
PageRank
Marian Stewart Bartlett12026183.92
gwen littlewort2115967.40
Ian R. Fasel365640.60
Javier R. Movellan41853150.44