Title
Vision-Based Measurement and Prediction of Object Trajectory for Robotic Manipulation in Dynamic and Uncertain Scenarios
Abstract
Vision-based measurement and prediction (VMP) are the very important and challenging part for autonomous robotic manipulation, especially in dynamic and uncertain scenarios. However, due to the potential limitations of visual measurement in such an environment such as occlusion, lighting, and hardware limitations, it is not easy to acquire the accurate positions of an object as the observations. Moreover, manipulating a dynamic object with unknown or uncertain motion rules usually requires an accurate prediction of motion trajectory at the desired moment, which dramatically increases the difficulty. To address the problem, we propose a time granularity-based vision prediction framework whose core is an integrated prediction model based on multiple [i.e., long short-term memory (LSTM)] neural networks. At first, we use the vision sensor to acquire raw measurements and adopt the preprocessing method (e.g., data completion, error compensation, and filtering) to turn raw measurements into the standard trajectory data. Then, we devise a novel integration strategy based on time granularity boost (TG-Boost) to select appropriate base predictors and further utilize these history trajectory data to construct the high-precision prediction model. Finally, we use the simulation and a series of dynamic manipulation experiments to validate the proposed methodology. The results also show that our method outperforms the state-of-the-art prediction algorithms in terms of prediction accuracy, success rate, and robustness.
Year
DOI
Venue
2020
10.1109/TIM.2020.2994602
IEEE Transactions on Instrumentation and Measurement
Keywords
DocType
Volume
Trajectory,Manipulator dynamics,Dynamics,Measurement uncertainty,Visualization,Predictive models
Journal
69
Issue
ISSN
Citations 
11
0018-9456
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Chongkun Xia121.76
Ching-Yen Weng201.35
Yunzhou Zhang321930.98
I-Ming Chen456787.28