Abstract | ||
---|---|---|
We propose a new approach toward evaluation of spoken dialog systems. The novelty of our method is based on utilization of domain-specific knowledge combined with the deterministic measurement of dialog system performance on a set of individual tasks within the domain. The proposed methodology thus attempts to answer questions such as: "How well is my dialog system performing on a specific domain?", "How much has my dialog system improved since the previous version?", "How much is my dialog system better/worse than other dialog systems performing on that domain?" |
Year | DOI | Venue |
---|---|---|
2009 | 10.1007/978-3-642-02574-7_32 | HCI (1) |
Keywords | Field | DocType |
domain-based evaluation,dialog system,proposed methodology,domain-specific knowledge,specific domain,previous version,individual task,dialog system performance,deterministic measurement,new approach,spoken dialog systems,system performance,speech recognition | Dialog box,Spoken dialog systems,Computer science,Semantic interpretation,Human–computer interaction,Natural language processing,Artificial intelligence,Dialog system,Novelty | Conference |
Volume | ISSN | Citations |
5610 | 0302-9743 | 0 |
PageRank | References | Authors |
0.34 | 8 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Jan Kleindienst | 1 | 220 | 23.74 |
Jan Cuřín | 2 | 31 | 5.51 |
Martin Labský | 3 | 23 | 6.77 |