Title | ||
---|---|---|
Talking face: using facial feature detection and image transformations for visual speech |
Abstract | ||
---|---|---|
Visual presentation of a talking person requires the generation of image frames showing the speaker in various views while pronouncing various phonemes. The existing approaches, mo stly use either a complex 3D geometric model to reconstruct a desired image or a set of 2D images for each viewpoint, to select from. We propose a new system which utilizes facial feature detection and image-based transformation to create any talking frame using only one given image from desired viewpoint and a set of reference images from one standard view. The proposed approach, together with optical flow-based view morphing and a customizable concatenative Text -To- Speech, makes a personalized visual speech generation system which can be used for moving/talking head applications where an optimal trade-of between computational complexity and image database requirements is necessary. |
Year | DOI | Venue |
---|---|---|
2001 | 10.1109/ICIP.2001.958280 | ICIP (3) |
Keywords | Field | DocType |
text to speech,face recognition,geometric model,speech synthesis,feature extraction,solid modeling,computer animation,head,optical flow,face detection,speech,computational complexity | Facial recognition system,Morphing,Computer vision,Speech synthesis,Feature detection (computer vision),Computer science,Geometric modeling,Feature extraction,Speech recognition,Artificial intelligence,Face detection,Optical flow | Conference |
Citations | PageRank | References |
1 | 0.36 | 6 |
Authors | ||
2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Ali Arya | 1 | 110 | 20.31 |
Hamidzadeh Babak | 2 | 184 | 24.99 |