Title
Local Policy Optimization for Trajectory-Centric Reinforcement Learning
Abstract
The goal of this paper is to present a method for simultaneous trajectory and local stabilizing policy optimization to generate local policies for trajectory-centric model-based reinforcement learning (MBRL). This is motivated by the fact that global policy optimization for non-linear systems could be a very challenging problem both algorithmically and numerically. However, a lot of robotic manipulation tasks are trajectory-centric, and thus do not require a global model or policy. Due to inaccuracies in the learned model estimates, an open-loop trajectory optimization process mostly results in very poor performance when used on the real system. Motivated by these problems, we try to formulate the problem of trajectory optimization and local policy synthesis as a single optimization problem. It is then solved simultaneously as an instance of nonlinear programming. We provide some results for analysis as well as achieved performance of the proposed technique under some simplifying assumptions.
Year
DOI
Venue
2020
10.1109/ICRA40945.2020.9197058
ICRA
DocType
Volume
Issue
Conference
2020
1
ISSN
Citations 
PageRank 
ICRA 2020
0
0.34
References 
Authors
17
7
Name
Order
Citations
PageRank
Kolaric Patrik101.35
Devesh K. Jha23211.10
Arvind U. Raghunathan316320.63
FRANK L. LEWIS45782402.68
Mouhacine Benosman54911.84
Diego Romeres643.12
Daniel Nikovski716531.87