Title
Incremental learning of gestures for human–robot interaction
Abstract
For a robot to cohabit with people, it should be able to learn people’s nonverbal social behavior from experience. In this paper, we propose a novel machine learning method for recognizing gestures used in interaction and communication. Our method enables robots to learn gestures incrementally during human–robot interaction in an unsupervised manner. It allows the user to leave the number and types of gestures undefined prior to the learning. The proposed method (HB-SOINN) is based on a self-organizing incremental neural network and the hidden Markov model. We have added an interactive learning mechanism to HB-SOINN to prevent a single cluster from running into a failure as a result of polysemy of being assigned more than one meaning. For example, a sentence: “Keep on going left slowly” has three meanings such as, “Keep on (1)”, “going left (2)”, “slowly (3)”. We experimentally tested the clustering performance of the proposed method against data obtained from measuring gestures using a motion capture device. The results show that the classification performance of HB-SOINN exceeds that of conventional clustering approaches. In addition, we have found that the interactive learning function improves the learning performance of HB-SOINN.
Year
DOI
Venue
2010
10.1007/s00146-009-0248-8
AI Soc.
Keywords
Field
DocType
motion capture device,hidden markov model,social robothuman-robot interaction � gesture recognitionunsupervised learningclustering � incremental learning,incremental learning,clustering performance,gestures incrementally,conventional clustering approach,interactive learning function,robot interaction,interactive learning mechanism,classification performance,gesture recognition,unsupervised learning,self organization,social behavior,machine learning,clustering,motion capture,human robot interaction,social robot,neural network
Robot learning,Competitive learning,Semi-supervised learning,Active learning (machine learning),Gesture,Computer science,Wake-sleep algorithm,Unsupervised learning,Artificial intelligence,Human–robot interaction
Journal
Volume
Issue
ISSN
25
2
1435-5655
Citations 
PageRank 
References 
2
0.38
13
Authors
4
Name
Order
Citations
PageRank
Shogo Okada110120.10
Yoichi Kobayashi220.38
Satoshi Ishibashi3184.12
Toyoaki Nishida41097196.19