Title
Don't Read My Lips: Assessing Listening and Speaking Skills Through Play with a Humanoid Robot.
Abstract
This study investigates the potential of using the humanoid robot, NAO, as a playful tool for assessing the listening and speaking skills of seven hearing-impaired students who use cochlear implant(s) and sign language as their main communication modality. NAO does not have a human mouth and therefore, students cannot do lip-reading; we considered this to be a unique characteristic of the technology that can help make the assessment of listening and speaking skills efficient and accurate. Three game-like applications were designed and deployed on NAO for the purpose of this study. Results demonstrated how NAO was successfully used in this context. Our results, although preliminary, should encourage future research in the area of listening and speaking assessment for hearing impaired children, as well as speech enhancement via play with social robots.
Year
DOI
Venue
2016
10.1007/978-3-319-40542-1_41
Communications in Computer and Information Science
Keywords
Field
DocType
NAO,Humanoid robot,Social robot,Robotics,Special education,Listening skills,Speaking skills,Speech assessment,Hearing impairment,Deaf
Speech enhancement,Social robot,Computer science,Active listening,Special education,Cochlear implant,Human–computer interaction,Sign language,Artificial intelligence,Multimedia,Robotics,Humanoid robot
Conference
Volume
ISSN
Citations 
618
1865-0929
1
PageRank 
References 
Authors
0.35
3
4
Name
Order
Citations
PageRank
Panayiota Polycarpou110.35
Anna Andreeva210.35
Andri Ioannou37721.51
Panayiotis Zaphiris496990.13