Title
Face Swapping under Large Pose Variations: A 3D Model Based Approach
Abstract
Traditional face swapping technologies require the faces of source images and target images have similar pose and appearance (usually frontal). This limits its applications. This paper presents a method for face swapping based on personalized 3D head models. This framework builds a personalized 3D head model from a frontal face and can be rendered at any pose to match the characters in the image we want to swap. The 3D head model is constructed by a user uploaded frontal view face image. This construction process goes through face alignment and feature point matching. The final personalized 3D head is built by deforming a standard 3D head model using radial basis function to match the specific person. To make the synthesized face seamlessly blended into the image, color transfer and multi-resolution spline technique are applied. We use the proposed technique to create personalized storybook where the characters are replaced with a user's face and promising results are obtained. The system can be used in face de-identification as well.
Year
DOI
Venue
2012
10.1109/ICME.2012.26
ICME
Keywords
Field
DocType
frontal face,radial basis function networks,large pose variations,face alignment,face swapping,traditional face,image matching,face recognition,synthesized face seamlessly,user uploaded frontal view face image,target image,face de-identification,face deidentification,frontal view face image,frontal face rendering,image resolution,face swapping technology,multiresolution spline technique,3d head reconstruction,rendering (computer graphics),standard 3d head model,pose estimation,image reconstruction,feature extraction,feature point matching,personalized 3d head models,source image,color transfer,head model,solid modelling,character matching,splines (mathematics),personalized storybook,multi-resolution spline,image colour analysis,radial basis function,face,solid modeling
Iterative reconstruction,Spline (mathematics),Computer vision,Facial recognition system,Pattern recognition,Computer science,Pose,Feature extraction,Solid modeling,Artificial intelligence,Face detection,Image resolution
Conference
ISSN
ISBN
Citations 
1945-7871
978-1-4673-1659-0
6
PageRank 
References 
Authors
0.40
0
4
Name
Order
Citations
PageRank
Yuan Lin19910.66
Shengjin Wang2145078.26
Qian Lin38810.97
Feng Tang460.40