Title
Detection of Listener Uncertainty in Robot-Led Second Language Conversation Practice
Abstract
Uncertainty is a frequently occurring affective state that learners experience during the acquisition of a second language. This state can constitute both a learning opportunity and a source of learner frustration. An appropriate detection could therefore benefit the learning process by reducing cognitive instability. In this study, we use a dyadic practice conversation between an adult second-language learner and a social robot to elicit events of uncertainty through the manipulation of the robot's spoken utterances (increased lexical complexity or prosody modifications). The characteristics of these events are then used to analyze multi-party practice conversations between a robot and two learners. Classification models are trained with multimodal features from annotated events of listener (un)certainty. We report the performance of our models on different settings, (sub)turn segments and multimodal inputs.
Year
DOI
Venue
2020
10.1145/3382507.3418873
ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION Virtual Event Netherlands October, 2020
DocType
ISBN
Citations 
Conference
978-1-4503-7581-8
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Ronald Cumbal111.36
José Lopes254.16
Olov Engwall319730.71