Title
Reinforcement learning of ball screw feed drive controllers
Abstract
Feedback controllers for ball screw feed drives may provide great accuracy in positioning, but have no close analytical solution to derive the desired controller. Reinforcement Learning (RL) is proposed to provide autonomous adaptation and learning of them. The RL paradigm allows different approaches, which are tested in this paper looking for the best suited for the ball screw drivers. Specifically, five algorithms are compared on an accurate simulation model of a commercial device, with and without a noisy disturbance on the state observation values. Benchmark results are provided by a double-loop PID controller, whose parameters have been tuned by a random search optimization. Action-critic methods with continuous action space (Policy-Gradient and CACLA) outperform the PID controller in the computational experiments, encouraging future research.
Year
DOI
Venue
2014
10.1016/j.engappai.2014.01.015
Eng. Appl. of AI
Keywords
Field
DocType
feedback controller,accurate simulation model,ball screw feed drive,pid controller,ball screw driver,benchmark result,rl paradigm,reinforcement learning,double-loop pid controller,action-critic method,feedback control
Ball screw,Random search,Control theory,Mathematical optimization,PID controller,Computer science,Simulation,Control theory,Reinforcement learning
Journal
Volume
ISSN
Citations 
30,
0952-1976
4
PageRank 
References 
Authors
0.45
12
4
Name
Order
Citations
PageRank
Borja Fernandez-Gauna1494.89
Igor Ansoategui281.64
Ismael Etxeberria-Agiriano340.45
Manuel Graña41367156.11