Title
Towards a method for evaluating naturalness in conversational dialog systems
Abstract
The evaluation of conversational dialog systems has remained a controversial topic, as it is challenging to quantitatively assess how well a conversation agent performs, or how much better one is compared to another. Furthermore, one of the hurdles which remains elusive in this quandary is the definition of naturalness, as demonstrated by how well a dialog system can maintain a natural conversation flow devoid of perceived awkwardness. As a step towards defining the dimensions of effectiveness and naturalness in a dialog system, this paper identifies existing evaluation practices which are then expanded to develop a more suitable assessment vehicle. This method is then applied to the LifeLike virtual avatar project.
Year
DOI
Venue
2009
10.1109/ICSMC.2009.5345904
SMC
Keywords
Field
DocType
multi agent systems,human computer interaction,artificial intelligence,software maintenance,data mining,conversational agent,artificial intelligent
Dialog box,Conversation,Computer science,Naturalness,Multi-agent system,Software,Human–computer interaction,Dialog system,Software maintenance,Avatar
Conference
ISSN
Citations 
PageRank 
1062-922X
8
0.59
References 
Authors
15
4
Name
Order
Citations
PageRank
Victor Chou Hung1201.48
Miguel Elvir2111.35
Avelino J. Gonzalez320442.36
R. F. DeMara452870.33