Title
A Solution to Time-Varying Markov Decision Processes.
Abstract
We consider a decision-making problem where the environment varies both in space and time. Such problems arise naturally when considering, e.g., the navigation of an underwater robot amidst ocean currents or the navigation of an aerial vehicle in wind. To model such spatiotemporal variation, we extend the standard Markov decision process (MDP) to a new framework called the time-varying Markov deci...
Year
DOI
Venue
2018
10.1109/LRA.2018.2801479
IEEE Robotics and Automation Letters
Keywords
Field
DocType
Space exploration,Markov processes,Hidden Markov models,Oceans,Vehicle dynamics,Standards
Horizon,Spacetime,Markov decision process,Control engineering,Artificial intelligence,Underwater robot,Ocean current,Engineering,Robotics
Journal
Volume
Issue
Citations 
3
3
1
PageRank 
References 
Authors
0.36
12
2
Name
Order
Citations
PageRank
Lantao Liu115716.49
Gaurav S. Sukhatme25469548.13