Title
A video prediction approach for animating single face image
Abstract
Generating dynamic 2D image-based facial expressions is a challenging task for facial animation. Much research work focused on performance-driven facial animation from given videos or images of a target face, while animating a single face image driven by emotion labels is a less explored problem. In this work, we treat the task of animating single face image from emotion labels as a conditional video prediction problem, and propose a novel framework by combining factored conditional restricted boltzmann machines (FCRBM) and reconstruction contractive auto-encoder (RCAE). A modified RCAE with an associated efficient training strategy is used to extract low dimensional features and reconstruct face images. FCRBM is used as animator to predict facial expression sequence in the feature space given discrete emotion labels and a frontal neutral face image as input. Both quantitative and qualitative evaluations on two facial expression databases, and comparison to state-of-the-art showed the effectiveness of our proposed framework for animating frontal neutral face image from given emotion labels.
Year
DOI
Venue
2019
10.1007/s11042-018-6952-y
Multimedia Tools and Applications
Keywords
Field
DocType
Facial expression animation, Image-based, FCRBM, Reconstruction contractive auto-encoder, Emotion
Computer vision,Feature vector,Pattern recognition,Computer science,Qualitative Evaluations,Image based,Facial expression,Artificial intelligence,Computer facial animation,Conditional restricted boltzmann machines
Journal
Volume
Issue
ISSN
78.0
12
1573-7721
Citations 
PageRank 
References 
0
0.34
21
Authors
4
Name
Order
Citations
PageRank
Yong Zhao1324.11
Meshia Cédric Oveneke2287.39
Jiang Dongmei311515.28
Hichem Sahli447565.19