Title
Discriminative Apprenticeship Learning with Both Preference and Non-preference Behavior
Abstract
Considering that expert's demonstrations are usually sub optimal and failed demonstrations often have some useful guidance, in this paper, a Discriminative Apprenticeship Learning algorithm is proposed, where the apprentice is taught with the join of failed attempts to acquire the ability that could discriminate the preference and non-preference cases so that to actively take a corresponding action. Since robot usually encounters changing environments, generalization ability is taken into account in the algorithm through which the reward function is recovered under the evaluation of generalization error. The problem of the representation error is also analyzed and involved in the algorithm. To ensure performance of the algorithm, theoretical guarantee is presented. Experiments on a simple car-driving robot and the comparison with a variety of inverse reinforcement learning methods are performed, which illustrate the proposed method is an effective and promising alternative.
Year
DOI
Venue
2013
10.1109/ICMLA.2013.64
ICMLA (1)
Keywords
Field
DocType
generalization ability,failed attempt,corresponding action,non-preference case,simple car-driving robot,discriminative apprenticeship learning algorithm,inverse reinforcement,non-preference behavior,generalization error,representation error,learning artificial intelligence,robots
Robot learning,Stability (learning theory),Instance-based learning,Active learning (machine learning),Computer science,Apprenticeship learning,Preference learning,Artificial intelligence,Machine learning,Reinforcement learning,Learning classifier system
Conference
Citations 
PageRank 
References 
0
0.34
7
Authors
3
Name
Order
Citations
PageRank
Dingsheng Luo14611.61
Yi Wang232.07
Xihong Wu327953.02