Title
Facial retargeting with automatic range of motion alignment
Abstract
While facial capturing focuses on accurate reconstruction of an actor's performance, facial animation retargeting has the goal to transfer the animation to another character, such that the semantic meaning of the animation remains. Because of the popularity of blendshape animation, this effectively means to compute suitable blendshape weights for the given target character. Current methods either require manually created examples of matching expressions of actor and target character, or are limited to characters with similar facial proportions (i.e., realistic models). In contrast, our approach can automatically retarget facial animations from a real actor to stylized characters. We formulate the problem of transferring the blendshapes of a facial rig to an actor as a special case of manifold alignment, by exploring the similarities of the motion spaces defined by the blendshapes and by an expressive training sequence of the actor. In addition, we incorporate a simple, yet elegant facial prior based on discrete differential properties to guarantee smooth mesh deformation. Our method requires only sparse correspondences between characters and is thus suitable for retargeting marker-less and marker-based motion capture as well as animation transfer between virtual characters.
Year
DOI
Venue
2017
10.1145/3072959.3073674
ACM Trans. Graph.
Keywords
Field
DocType
facial animation,retargeting,blendshapes
Motion capture,Computer vision,Expression (mathematics),Computer science,Manifold alignment,Retargeting,Artificial intelligence,Animation,Computer facial animation,Computer animation,Facial motion capture
Journal
Volume
Issue
ISSN
36
4
0730-0301
Citations 
PageRank 
References 
6
0.43
33
Authors
5
Name
Order
Citations
PageRank
Roger Blanco i Ribera1182.04
Eduard Zell2294.13
J. P. Lewis31936138.76
Junyong Noh4434.51
Mario Botsch52385116.10