Name
Abstract | ||
|---|---|---|
The paper presents an implemented model for priming speech recognition, using contextual information about salient entities. The underlying hypothesis is that, in human-robot interaction, speech recognition performance can be improved by exploiting knowledge about the immediate physical situation and the dialogue history. To this end, visual salience (objects perceived in the physical scene) and linguistic salience (objects, events already mentioned in the dialogue) are integrated into a single cross-modal salience model. The model is dynamically updated as the environment changes. It is used to establish expectations about which words are most likely to be heard in the given context. The update is realised by continuously adapting the word-class probabilities specified in a statistical language model. The paper discusses the motivations behind the approach, and presents the implementation as part of a cognitive architecture for mobile robots. Evaluation results on a test suite show a statistically significant improvement of salience-driven priming speech recognition (WER) over a commercial baseline system. |
Year | DOI | Venue |
|---|---|---|
2008 | 10.3233/978-1-58603-891-5-636 | ECAI |
Keywords | Field | DocType |
visual salience,immediate physical situation,physical scene,linguistic salience,statistical language model,dialogue history,salience-driven priming speech recognition,speech recognition performance,human-robot interaction,salience-driven contextual priming,priming speech recognition,single cross-modal salience model,speech recognition,human robot interaction,mobile robot,word error rate,software architecture,language model,statistical significance | Test suite,Cache language model,Computer science,Natural language processing,Artificial intelligence,Cognitive architecture,Salience (language),Language model,Human–robot interaction,Priming (psychology),Speech recognition,Machine learning,Mobile robot | Conference |
Volume | ISSN | Citations |
178 | 0922-6389 | 14 |
PageRank | References | Authors |
0.67 | 25 | 2 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Pierre Lison | 1 | 146 | 12.35 |
| Geert-Jan Kruijff | 2 | 78 | 4.79 |