Name
Abstract | ||
|---|---|---|
In this paper, we describe a set of metrics for the evaluation of different
dialogue management strategies in an implemented real-time spoken language
system. The set of metrics we propose offers useful insights in evaluating how
particular choices in the dialogue management can affect the overall quality of
the man-machine dialogue. The evaluation makes use of established metrics: the
transaction success, the contextual appropriateness of system answers, the
calculation of normal and correction turns in a dialogue. We also define a new
metric, the implicit recovery, which allows to measure the ability of a
dialogue manager to deal with errors by different levels of analysis. We report
evaluation data from several experiments, and we compare two different
approaches to dialogue repair strategies using the set of metrics we argue for. |
Year | Venue | Keywords |
|---|---|---|
1996 | Clinical Orthopaedics and Related Research | real time |
Field | DocType | Volume |
Dialogue management,Computer science,Artificial intelligence,Natural language processing,Database transaction,Report evaluation,Spoken language | Journal | cmp-lg/9612003 |
Citations | PageRank | References |
73 | 10.99 | 6 |
Authors | ||
2 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Morena Danieli | 1 | 161 | 32.23 |
| Elisabetta Gerbino | 2 | 98 | 19.87 |