Title
Assessing Agreement In Human-Robot Dialogue Strategies: A Tale Of Two Wizards
Abstract
The Wizard-of-Oz (WOz) method is a common experimental technique in virtual agent and human-robot dialogue research for eliciting natural communicative behavior from human partners when full autonomy is not yet possible. For the first phase of our research reported here, wizards play the role of dialogue manager, acting as a robot's dialogue processing. We describe a novel step within WOz methodology that incorporates two wizards and control sessions: the wizards function much like corpus annotators, being asked to make independent judgments on how the robot should respond when receiving the same verbal commands in separate trials. We show that inter-wizard discussion after the control sessions and the resolution with a reconciled protocol for the follow-on pilot sessions successfully impacts wizard behaviors and significantly aligns their strategies. We conclude that, without control sessions, we would have been unlikely to achieve both the natural diversity of expression that comes with multiple wizards and a better protocol for modeling an automated system.
Year
DOI
Venue
2016
10.1007/978-3-319-47665-0_60
INTELLIGENT VIRTUAL AGENTS, IVA 2016
Keywords
Field
DocType
Natural language dialogue, Human-robot communication
Computer science,Virtual agent,Autonomy,Robot,Multimedia,Human–robot interaction,Wizard
Conference
Volume
ISSN
Citations 
10011
0302-9743
2
PageRank 
References 
Authors
0.38
1
8
Name
Order
Citations
PageRank
Matthew Marge126123.90
Claire Bonial223218.02
Kimberly A. Pollard343.80
Ron Artstein480759.76
Brendan Byrne520.38
Susan G. Hill6385.73
Clare R. Voss734429.51
David Traum881280.55