Name
Abstract | ||
|---|---|---|
This paper presents a complete framework for creating a speech-enabled avatar from a single image of a person. Our approach uses a generic facial motion model which represents deformations of a prototype face during speech. We have developed an HMM-based facial animation algorithm which takes into account both lexical stress and coarticulation. This algorithm produces realistic animations of the prototype facial surface from either text or speech. The generic facial motion model can be transformed to a novel face geometry using a set of corresponding points between the prototype face surface and the novel face. Given a face photograph, a small number of manually selected features in the photograph are used to deform the prototype face surface. The deformed surface is then used to animate the face in the photograph. We show several examples of avatars that are driven by text and speech inputs. |
Year | DOI | Venue |
|---|---|---|
2008 | 10.1109/VR.2008.4480758 | IEEE VIRTUAL REALITY 2008, PROCEEDINGS |
Keywords | Field | DocType |
eye gaze,vector field,face recognition,hidden markov model,real time rendering,stress,texture synthesis,hidden markov models,speech synthesis,computer graphic,prototypes,face geometry,computer animation,computer graphics,rendering system,solid modeling,computational geometry,coarticulation,facial animation | Computer vision,Facial recognition system,Speech synthesis,Computer graphics (images),Computer science,Coarticulation,Computer facial animation,Artificial intelligence,Computer animation,Hidden Markov model,Computer graphics,Face (geometry) | Conference |
Citations | PageRank | References |
4 | 0.44 | 13 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Dmitri Bitouk | 1 | 238 | 9.65 |
| Shree K. Nayar | 2 | 12394 | 1538.46 |