Title
Visual monitoring of surface deformations on objects manipulated with a robotic hand
Abstract
Nowadays dexterous manipulation of rigid objects using a robot hand can be achieved fairly well. However, grasping and manipulating deformable objects is still challenging as the force and tactile sensors which are commonly used in such applications can only provide local information about the deformation at the contact points. In this paper, a vision framework is proposed for 3D visually guided grasping and manipulation of deformable objects. This visual monitoring framework, which uses state-of-the-art computer vision methods, provides a robotic hand system with comprehensive monitoring of the deformable object that it manipulates as it tracks its deformation. Stereoscopic vision is used to detect and track in real time the deformation of non-rigid objects in three dimensions and within a complex environment. The technique is tested successfully in real robotic operation conditions using the Barrett hand. The actual object shape is rendered in the 3D virtual environment of the GraspIt! robotic simulator which also displays the hand configuration.
Year
DOI
Venue
2010
10.1109/ROSE.2010.5675327
Robotic and Sensors Environments
Keywords
Field
DocType
deformation,dexterous manipulators,force sensors,grippers,object detection,rendering (computer graphics),robot vision,shape recognition,solid modelling,stereo image processing,tactile sensors,virtual reality,3D visually guided grasping,Barrett hand,computer vision,dexterous manipulation,force sensor,object shape rendering,robotic hand,stereoscopic vision,surface deformation,tactile sensor,virtual environment,visual monitoring,3D vision,deformable objects,deformation estimation,dexterous manipulation
Object detection,Computer vision,Virtual reality,Virtual machine,Computer graphics (images),Stereopsis,Visualization,Artificial intelligence,Engineering,Visual monitoring,Grippers,Tactile sensor
Conference
ISBN
Citations 
PageRank 
978-1-4244-7147-8
2
0.38
References 
Authors
0
3
Name
Order
Citations
PageRank
Fouad F. Khalil120.38
Phillip Curtis220.38
Pierre Payeur330.76