Title
Safe Reinforcement Learning for Continuous Spaces through Lyapunov-Constrained Behavior.
Abstract
This paper presents a safe learning strategy for continuous state and action spaces by utilizing Lyapunov stability properties of the studied systems. The reinforcement learning algorithm Continous Actor-Critic Learning Automation (CACLA) is combined with the notion of control Lyapunov functions (CLF) to limit the learning and exploration behavior to operate inside the stability region of the system to ensure safe operation at all times. The paper extends previous results for discrete action sets to take advantage of the more general continuous actions sets, and show that the continuous method is able to find a comparable solution to the best discrete action choices while avoiding the need for good heuristic choices in the design process.
Year
DOI
Venue
2011
10.3233/978-1-60750-754-3-70
Frontiers in Artificial Intelligence and Applications
Keywords
Field
DocType
Safe learning,reinforcement learning,control Lyapunov function
Lyapunov function,Computer science,Artificial intelligence,Reinforcement learning
Conference
Volume
ISSN
Citations 
227
0922-6389
1
PageRank 
References 
Authors
0.39
0
2
Name
Order
Citations
PageRank
Sigurd Aksnes Fjerdingen1142.46
Erik Kyrkjebø2194.55