Title
The roles of haptic-ostensive referring expressions in cooperative, task-based human-robot dialogue
Abstract
Generating referring expressions is a task that has received a great deal of attention in the natural-language generation community, with an increasing amount of recent effort targeted at the generation of multimodal referring expressions. However, most implemented systems tend to assume very little shared knowledge between the speaker and the hearer, and therefore must generate fully-elaborated linguistic references. Some systems do include a representation of the physical context or the dialogue context; however, other sources of contextual information are not normally used. Also, the generated references normally consist only of language and, possibly, deictic pointing gestures. When referring to objects in the context of a task-based interaction involving jointly manipulating objects, a much richer notion of context is available, which permits a wider range of referring options. In particular, when conversational partners cooperate on a mutual task in a shared environment, objects can be made accessible simply by manipulating them as part of the task. We demonstrate that such expressions are common in a corpus of human-human dialogues based on constructing virtual objects, and then describe how this type of reference can be incorporated into the output of a humanoid robot that engages in similar joint construction dialogues with a human partner.
Year
DOI
Venue
2008
10.1145/1349822.1349861
HRI
Keywords
Field
DocType
great deal,physical context,fully-elaborated linguistic reference,human partner,conversational partner,mutual task,task-based human-robot dialogue,shared environment,dialogue context,contextual information,natural-language generation community,human robot interaction,color,natural language processing,pragmatics,robot kinematics,humanoid robot
Contextual information,Expression (mathematics),Gesture,Computer science,Human–computer interaction,Deixis,Ostensive definition,Haptic technology,Human–robot interaction,Humanoid robot
Conference
ISSN
ISBN
Citations 
2167-2121
978-1-60558-017-3
17
PageRank 
References 
Authors
0.87
9
6
Name
Order
Citations
PageRank
Mary Ellen Foster136436.47
Ellen G Bard29716.22
Markus Guhe31059.01
Robin L. Hill419613.74
Jon Oberlander578378.55
Alois Knoll Knoll61700271.32