Name
Title | ||
|---|---|---|
Audio visual speech recognition based on multi-stream DBN models with Articulatory Features |
Abstract | ||
|---|---|---|
We present a multi-stream Dynamic Bayesian Network model with Articulatory Features (AF_AV_DBN) for audio visual speech recognition. Conditional probability distributions of the nodes are defined considering the asynchronies between the articulatory features (AFs). Speech recognition experiments are carried out on an audio visual connected digit database. Results show that comparing with the state synchronous DBN model (SS_DBN) and state asynchronous DBN model (SA_DBN), when the asynchrony constraint between the AFs is appropriately set, the AF_AV_DBN model gets the highest recognition rates, with average recognition rate improved to 89.38% from 87.02% of SS_DBN and 88.32% of SA_DBN. Moreover, the audio visual multi-stream AF_AV_DBN model greatly improves the robustness of the audio only AF_A_DBN model, for example, under the noise of -10dB, the recognition rate is improved from 20.75% to 76.24%. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1109/ISCSLP.2010.5684915 | ISCSLP |
Keywords | Field | DocType |
statistical distributions,state asynchronous dbn model,belief networks,dbn,speech recognition,articulatory feature,audio visual connected digit database,afavdbn model,audio-visual,asynchrony constraint,multistream dbn model,audio visual speech recognition,feature extraction,multistream dynamic bayesian network model,audio-visual systems,conditional probability distribution,recognition rate,dynamic bayesian network,hidden markov models,visualization,conditional probability,noise,speech,speech processing | Speech processing,Pattern recognition,Conditional probability,Computer science,Speech recognition,Feature extraction,Robustness (computer science),Probability distribution,Audio-visual speech recognition,Artificial intelligence,Hidden Markov model,Dynamic Bayesian network | Conference |
Volume | Issue | ISBN |
null | null | 978-1-4244-6244-5 |
Citations | PageRank | References |
0 | 0.34 | 2 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| DongMei Jiang | 1 | 124 | 19.03 |
| Peng Wu | 2 | 61 | 8.08 |
| Fengna Wang | 3 | 41 | 2.94 |
| Hichem Sahli | 4 | 475 | 65.19 |
| Werner Verhelst | 5 | 431 | 51.55 |