Name
Abstract | ||
|---|---|---|
This paper provides improved confidence assessment for detection of word-level speech recognition errors and out-of-domain user requests using language model features. We consider a combined measure of confidence that utilizes the language model back-off sequence, language model score, and phonetic length of recognized words as indicators of speech recognition confidence. The paper investigates the ability of each feature to detect speech recognition errors and out-of-domain utterances as well as two methods for combining the features contextually: a multi-layer perceptron and a statistical decision tree. We illustrate the effectiveness of the algorithm by considering utterances from the ATIS airline information task as either in-domain and out-of-domain for the DARPA Communicator task. Using this hand-labeled data, it is shown that 27.9% of incorrectly recognized words and 36.4% of out-of-domain phrases are detected at a 2.5% false alarm rate. |
Year | DOI | Venue |
|---|---|---|
2000 | 10.1109/ICASSP.2000.859190 | Acoustics, Speech, and Signal Processing, 2000. ICASSP '00. Proceedings. 2000 IEEE International Conference |
Keywords | Field | DocType |
decision trees,interactive systems,speech recognition,speech-based user interfaces,ATIS airline information task,CU Communicator system,DARPA Communicator task,back-off sequence,confidence measures,dialogue management,incorrectly recognized words,language model features,language model score,multi-layer perceptron,out-of-domain phrases,out-of-domain user requests,out-of-domain utterances,phonetic length,recognized words,speech recognition confidence,statistical decision tree,word-level speech recognition errors | Decision tree,Computer science,Speech recognition,Robustness (computer science),Multilayer perceptron,Natural language,Artificial intelligence,Natural language processing,Decoding methods,Constant false alarm rate,Perceptron,Language model | Conference |
Volume | ISSN | ISBN |
2 | 1520-6149 | 0-7803-6293-4 |
Citations | PageRank | References |
13 | 1.83 | 4 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Rubén San-Segundo-Hernández | 1 | 173 | 29.60 |
| Bryan Pellom | 2 | 660 | 59.45 |
| Wayne Ward | 3 | 1000 | 93.39 |
| José Manuel Pardo | 4 | 152 | 30.36 |