Title
Dynamic Facial Expression Analysis and Synthesis With MPEG-4 Facial Animation Parameters
Abstract
This paper describes a probabilistic framework for faithful reproduction of dynamic facial expressions on a synthetic face model with MPEG-4 facial animation parameters (FAPs) while achieving very low bitrate in data transmission. The framework consists of a coupled Bayesian network (BN) to unify the facial expression analysis and synthesis into one coherent structure. At the analysis end, we cast the FAPs and facial action coding system (FACS) into a dynamic Bayesian network (DBN) to account for uncertainties in FAP extraction and to model the dynamic evolution of facial expressions. At the synthesizer, a static BN reconstructs the FAPs and their intensity. The two BNs are connected statically through a data stream link. Using the coupled BN to analyze and synthesize the dynamic facial expressions is the major novelty of this work. The novelty brings about several benefits. First, very low bitrate (9 bytes per frame) in data transmission can be achieved. Second, a facial expression is inferred through both spatial and temporal inference so that the perceptual quality of animation is less affected by the misdetected FAPs. Third, more realistic looking facial expressions can be reproduced by modelling the dynamics of human expressions.
Year
DOI
Venue
2008
10.1109/TCSVT.2008.928887
IEEE Trans. Circuits Syst. Video Techn.
Keywords
Field
DocType
mpeg-4 facial animation parameter,facial action,misdetected faps,facial expression,facial expression analysis,mpeg-4 facial animation parameters,dynamic evolution,dynamic facial expression analysis,low bitrate,data transmission,dynamic facial expression,dynamic bayesian network,bayesian methods,facial action coding system,uncertainty,bayesian networks,couplings,face recognition,computer animation,facial animation,coherent structures,network synthesis,data mining,bayesian network
Computer vision,Facial recognition system,Facial Action Coding System,Pattern recognition,Expression (mathematics),Computer science,Bayesian network,Facial expression,Computer facial animation,Artificial intelligence,Computer animation,Dynamic Bayesian network
Journal
Volume
Issue
ISSN
18
10
1051-8215
Citations 
PageRank 
References 
26
1.10
33
Authors
4
Name
Order
Citations
PageRank
Yongmian Zhang138118.78
Qiang Ji22780168.90
Zhiwei Zhu3261.10
Beifang Yi4443.43