Name
Title | ||
|---|---|---|
Filtering sensory information with XCSF: improving learning robustness and control performance |
Abstract | ||
|---|---|---|
It was previously shown that the control of a robot arm can be efficiently learned using the XCSF classifier system. So far, however, the predictive knowledge about how actual motor activity changes the state of the arm system has not been exploited. In this paper, we exploit the forward velocity kinematics knowledge of XCSF to alleviate the negative effect of noisy sensors for successful learning and control. We incorporate Kalman filtering for estimating successive arm positions iteratively combining sensory readings with XCSF-based predictions of hand position changes over time. The filtered arm position is used to improve both trajectory planning and further learning of the forward velocity kinematics. We test the approach on a simulated, kinematic robot arm model. The results show that the combination can improve learning and control performance significantly. However, it also shows that variance estimates of XCSF predictions maybe underestimated, in which case self-delusional spiraling effects hinder effective learning. Thus, we introduce a heuristic parameter, which limits the influence of XCSF's predictions on its own further learning input. As a result, we obtain drastic improvements in noise tolerance coping with more than ten times higher noise levels. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1145/2330163.2330284 | GECCO |
Keywords | Field | DocType |
kinematic robot arm model,effective learning,arm system,xcsf classifier system,filtered arm position,xcsf prediction,successful learning,robot arm,learning input,successive arm position,control performance,sensory information,learning classifier system,kalman filter,robotics,function approximation,noise | Heuristic,Robotic arm,Kinematics,Function approximation,Computer science,Filter (signal processing),Kalman filter,Robustness (computer science),Artificial intelligence,Robotics,Machine learning | Conference |
Citations | PageRank | References |
3 | 0.43 | 18 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Jan Kneissler | 1 | 25 | 3.94 |
| Patrick O. Stalph | 2 | 74 | 5.95 |
| Jan Drugowitsch | 3 | 39 | 3.80 |
| Martin V. Butz | 4 | 1065 | 85.21 |