Title
3D Magic Mirror: Automatic Video to 3D Caricature Translation.
Abstract
Caricature is an abstraction of a real person which distorts or exaggerates certain features, but still retains a likeness. While most existing works focus on 3D caricature reconstruction from 2D caricatures or translating 2D photos to 2D caricatures, this paper presents a real-time and automatic algorithm for creating expressive 3D caricatures with caricature style texture map from 2D photos or videos. To solve this challenging ill-posed reconstruction problem and cross-domain translation problem, we first reconstruct the 3D face shape for each frame, and then translate 3D face shape from normal style to caricature style by a novel identity and expression preserving VAE-CycleGAN. Based on a labeling formulation, the caricature texture map is constructed from a set of multi-view caricature images generated by CariGANs. The effectiveness and efficiency of our method are demonstrated by comparison with baseline implementations. The perceptual study shows that the 3D caricatures generated by our method meet people's expectations of 3D caricature style.
Year
Venue
DocType
2019
arXiv: Graphics
Journal
Volume
Citations 
PageRank 
abs/1906.00544
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Yudong Guo1173.67
Jiang Luo2204.01
Lin Cai342.19
Juyong Zhang437934.08