Name
Title | ||
|---|---|---|
Using model trees for evaluating dialog error conditions based on acoustic information |
Abstract | ||
|---|---|---|
This paper examines the use of model trees for evaluating user utterances for response to system error in dialogs from the Communicator 2000 corpus. The features used by the model trees are limited to those which can be automatically obtained through acoustic measurements. These features are derived from pitch and energy measurements. The curve of the model tree output versus dialog turn is interpreted to be a measure of the level of user activation in the dialog. We test the premise that user response to error at the utterance level is related to user satisfaction at the dialog level. Several different evaluation tasks are investigated: on an utterance level we applied the model tree output to detecting response to error and on the dialog level we analyzed the relation of model tree output to estimating user satisfaction. For the former, we achieve 65% precision and 63% recall and for the latter our predictions show significant .48 correlation with user surveys. |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1145/1178745.1178763 | Proceedings of the 1st ACM international workshop on Human-centered multimedia |
Keywords | DocType | ISBN |
evaluation of human-computer dialog systems,acoustic information,user utterance,paralinguistic feedback,user satisfaction,utterance level,dialog turn,user response,user activation,model tree,model tree output,dialog error condition,user response to error,dialog level,user survey | Conference | 1-59593-500-2 |
Citations | PageRank | References |
1 | 0.40 | 16 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Abe Kazemzadeh | 1 | 957 | 52.95 |
| Sungbok Lee | 2 | 1394 | 84.13 |
| Narayanan Shrikanth | 3 | 5558 | 439.23 |