Abstract | ||
---|---|---|
User judgments of Spoken Dialog Systems provide evaluators of such systems with a valid measure of their overall quality. Models for the automatic prediction of user judgments have been built, following the introduction of PARADISE [1]. Main applications are the comparison of systems, the analysis of parameters affecting quality, and the adoption of dialog management strategies. However, a common model which applies to different systems and users has not been found so far. With the aim of getting a closer insight into the quality-relevant characteristics of spoken interactions, an experiment was conducted where 25 users judged the same 5 dialogs. User judgments were collected after each dialog turn. The paper presents an analysis of the obtained results and some conclusions for future work. |
Year | Venue | Keywords |
---|---|---|
2009 | INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5 | spoken dialog systems, PARADISE, evaluation |
Field | DocType | Citations |
Spoken dialog systems,Computer science,Speech recognition,Dialog system | Conference | 2 |
PageRank | References | Authors |
0.48 | 1 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Klaus-Peter Engelbrecht | 1 | 98 | 10.88 |
Felix Hartard | 2 | 26 | 1.82 |
Florian Gödde | 3 | 42 | 2.93 |
Sebastian Möller | 4 | 877 | 141.17 |