Title
Autonomous table-cleaning from kinesthetic demonstrations using Deep Learning
Abstract
We address the problem of teaching a robot how to autonomously perform table-cleaning tasks in a robust way. In particular, we focus on wiping and sweeping a table with a tool (e.g., a sponge). For the training phase, we use a set of kinesthetic demonstrations performed over a table. The recorded 2D table-space trajectories, together with the images acquired by the robot, are used to train a deep convolutional network that automatically learns the parameters of a Gaussian Mixture Model that represents the hand movement. After the learning stage, the network is fed with the current image showing the location/shape of the dirt or stain to clean. The robot is able to perform cleaning arm-movements, obtained through Gaussian Mixture Regression using the mixture parameters provided by the network. Invariance to the robot posture is achieved by applying a plane-projective transformation before inputting the images to the neural network; robustness to illumination changes and other disturbances is increased by considering an augmented data set. This improves the generalization properties of the neural network, enabling for instance its use with the left arm after being trained using trajectories acquired with the right arm. The system was tested on the iCub robot generating a cleaning behaviour similar to the one of human demonstrators.
Year
DOI
Venue
2018
10.1109/DEVLRN.2018.8761013
2018 Joint IEEE 8th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)
Keywords
Field
DocType
kinesthetic demonstrations,table-space trajectories,cleaning arm-movements,robot posture,neural network,iCub robot,human demonstrators,autonomous table-cleaning,deep learning,deep convolutional network training,Gaussian mixture model,Gaussian mixture regression
Kinesthetic learning,Computer vision,iCub,Invariant (physics),Computer science,Robustness (computer science),Artificial intelligence,Deep learning,Artificial neural network,Robot,Mixture model
Conference
ISSN
ISBN
Citations 
2161-9484
978-1-5386-6111-6
0
PageRank 
References 
Authors
0.34
10
7
Name
Order
Citations
PageRank
Nino Cauli1233.03
Vicente, P.2155.46
Jaeseok Kim340558.33
Bruno Damas4546.25
Alexandre Bernardino571078.77
Filippo Cavallo631158.89
Santos-Victor, J.71747169.53