Title
Talking face: using facial feature detection and image transformations for visual speech
Abstract
Visual presentation of a talking person requires the generation of image frames showing the speaker in various views while pronouncing various phonemes. The existing approaches, mo stly use either a complex 3D geometric model to reconstruct a desired image or a set of 2D images for each viewpoint, to select from. We propose a new system which utilizes facial feature detection and image-based transformation to create any talking frame using only one given image from desired viewpoint and a set of reference images from one standard view. The proposed approach, together with optical flow-based view morphing and a customizable concatenative Text -To- Speech, makes a personalized visual speech generation system which can be used for moving/talking head applications where an optimal trade-of between computational complexity and image database requirements is necessary.
Year
DOI
Venue
2001
10.1109/ICIP.2001.958280
ICIP (3)
Keywords
Field
DocType
text to speech,face recognition,geometric model,speech synthesis,feature extraction,solid modeling,computer animation,head,optical flow,face detection,speech,computational complexity
Facial recognition system,Morphing,Computer vision,Speech synthesis,Feature detection (computer vision),Computer science,Geometric modeling,Feature extraction,Speech recognition,Artificial intelligence,Face detection,Optical flow
Conference
Citations 
PageRank 
References 
1
0.36
6
Authors
2
Name
Order
Citations
PageRank
Ali Arya111020.31
Hamidzadeh Babak218424.99