Title
Model-Based Actor-Critic Learning of Robotic Impedance Control in Complex Interactive Environment
Abstract
In complex robot applications, such as human-robot interaction and robot machining, robots should interact with an unknown environment. To learn the interactive skill, a model-based actor-critic learning algorithm and a safety-learning strategy are proposed in this article to find the optimal impedance control, in which the learning process is safe and fully automatic and does not know the system parameter. In the learning algorithm, a critic is defined as a quadratic form of the system states and the external force. A modified deterministic policy gradient algorithm is presented to improve the learning efficiency. The proposed approach utilizes a model-based constraint and a highly efficient learning algorithm. In the safety-learning strategy, the robot is trained under a constant force, and the learned impedance control can transfer to different interaction situations by choosing the suitable impedance index. The effectiveness of the learning algorithm and the performance of the learned impedance control are validated in a UR5 robot. The robot can perform human-robot interaction and robot machining tasks after the training process with 100 s training time.
Year
DOI
Venue
2022
10.1109/TIE.2021.3134082
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
Keywords
DocType
Volume
Actor-critic learning, human-robot interaction, impedance control, robot machining
Journal
69
Issue
ISSN
Citations 
12
0278-0046
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Xingwei Zhao101.01
Shibo Han200.68
Bo Tao33717.60
Zhouping Yin422829.67
Han Ding549978.16