Title
Augmented makeover based on 3D morphable model
Abstract
Avatar is the virtual representation of user's facial, body, and motion characteristics in computer game, social network, and augmented reality. Facial modeling needs enormous efforts to achieve immersive experience in applications like avatar chatting or online makeover. Great challenge exists in robust detection of 2D facial prominent points and mapping them to 3D models in a parameterized manner. Another challenge is how to characterize semantic components of eyes, mouth, nose, and cheek rather than low level mesh geometries. In this paper, we proposed an augmented makeover framework to deal with aforementioned challenges. Aiming to provide amateurs with flexible customizations, morphable model is constructed from a set of scanned 3D face data set. Appearance personalization is carried out in the offline phase where single image and multiple views are discussed respectively to generate deformative shape in a progressive manner. Augmentation is implemented in the online phase where a fast and robust 3D tracking is used to balance the tradeoff between accuracy and real-time requirements. By this means, immersive Human Computer Interaction such as virtual makeover and photo-realistic avatar chatting could be achieved.
Year
DOI
Venue
2011
10.1145/2072298.2072067
ACM Multimedia 2001
Keywords
Field
DocType
online makeover,aforementioned challenge,virtual makeover,great challenge,facial prominent point,morphable model,augmented reality,photo-realistic avatar,augmented makeover,augmented makeover framework,immersive human computer interaction,facial modeling,real time,human computer interaction,social network,structure analysis,surface reconstruction
Structure analysis,Computer vision,Parameterized complexity,Virtual representation,Computer science,Augmented reality,Artificial intelligence,Immersion (virtual reality),3d tracking,Avatar,Personalization
Conference
Citations 
PageRank 
References 
2
0.37
4
Authors
6
Name
Order
Citations
PageRank
Patricia Wang120.37
Xiaofeng Tong233622.08
Yangzhou Du316913.85
Jianguo Li437735.38
Wei Hu518214.17
Yimin Zhang61536130.17