Title
Deep 3D caricature face generation with identity and structure consistency
Abstract
This paper proposed a novel approach to generate face caricatures automatically from a single portrait image. We decompose the process of 3D face caricatures generation into two independent subtasks: appearance transfer of texture and the geometry transfer of mesh. For the appearance transfer, we design a GAN-based network named CariFaceGAN to learn the style mapping from portrait to caricature, in which facial features are leveraged to preserve identity consistency. For geometry transfer, we first learn the transformation of the landmarks between portraits and caricatures in an embedded space obtained with Locally Linear Embedding method, and then Kriging interpolation is used to manipulate the portrait mesh constructed from a single image. The experimental results show that our proposed CariFaceGAN outperforms the state-of-the-art methods in terms of maintaining identity consistency and providing satisfactory visual effects.
Year
DOI
Venue
2021
10.1016/j.neucom.2021.05.014
Neurocomputing
Keywords
DocType
Volume
Style transfer,Generative Adversarial Networks,3D face mesh,Caricature
Journal
454
ISSN
Citations 
PageRank 
0925-2312
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Song Li100.34
Songzhi Su28810.67
Juncong Lin310520.73
Guo-Rong Cai45811.42
Li Sun500.34