Name
Abstract | ||
|---|---|---|
We describe an unsupervised probabilistic approach for synthesising visual speech from audio. Acoustic features representing a training corpus are clustered and the probability density function (PDF) of each cluster is modelled as a Gaussian mixture model (GMM). A visual target in the form of a short-term parameter trajectory is generated for each cluster. Synthesis involves combining the cluster targets based on the likelihood of novel acoustic feature vectors, then cross-blending neighbouring regions of the synthesised short-term trajectories. The advantage of our approach is coarticulation effects are explicitly captured by the mapping. The influence of cluster targets naturally increase and decrease with the likelihood of the acoustic feature vectors. |
Year | Venue | Keywords |
|---|---|---|
2008 | INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5 | visual speech synthesis, speech-driven talking heads |
Field | DocType | Citations |
Pattern recognition,Computer science,Speech recognition,Artificial intelligence,Probabilistic logic,Trajectory | Conference | 2 |
PageRank | References | Authors |
0.36 | 1 | 2 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Barry-John Theobald | 1 | 332 | 25.39 |
| Nicholas Wilkinson | 2 | 10 | 1.90 |