Title
ADiEU: Toward Domain-Based Evaluation of Spoken Dialog Systems
Abstract
We propose a new approach toward evaluation of spoken dialog systems. The novelty of our method is based on utilization of domain-specific knowledge combined with the deterministic measurement of dialog system performance on a set of individual tasks within the domain. The proposed methodology thus attempts to answer questions such as: "How well is my dialog system performing on a specific domain?", "How much has my dialog system improved since the previous version?", "How much is my dialog system better/worse than other dialog systems performing on that domain?"
Year
DOI
Venue
2009
10.1007/978-3-642-02574-7_32
HCI (1)
Keywords
Field
DocType
domain-based evaluation,dialog system,proposed methodology,domain-specific knowledge,specific domain,previous version,individual task,dialog system performance,deterministic measurement,new approach,spoken dialog systems,system performance,speech recognition
Dialog box,Spoken dialog systems,Computer science,Semantic interpretation,Human–computer interaction,Natural language processing,Artificial intelligence,Dialog system,Novelty
Conference
Volume
ISSN
Citations 
5610
0302-9743
0
PageRank 
References 
Authors
0.34
8
3
Name
Order
Citations
PageRank
Jan Kleindienst122023.74
Jan Cuřín2315.51
Martin Labský3236.77