Abstract | ||
---|---|---|
We consider a decision-making problem where the environment varies both in space and time. Such problems arise naturally when considering, e.g., the navigation of an underwater robot amidst ocean currents or the navigation of an aerial vehicle in wind. To model such spatiotemporal variation, we extend the standard Markov decision process (MDP) to a new framework called the time-varying Markov deci... |
Year | DOI | Venue |
---|---|---|
2018 | 10.1109/LRA.2018.2801479 | IEEE Robotics and Automation Letters |
Keywords | Field | DocType |
Space exploration,Markov processes,Hidden Markov models,Oceans,Vehicle dynamics,Standards | Horizon,Spacetime,Markov decision process,Control engineering,Artificial intelligence,Underwater robot,Ocean current,Engineering,Robotics | Journal |
Volume | Issue | Citations |
3 | 3 | 1 |
PageRank | References | Authors |
0.36 | 12 | 2 |
Name | Order | Citations | PageRank |
---|---|---|---|
Lantao Liu | 1 | 157 | 16.49 |
Gaurav S. Sukhatme | 2 | 5469 | 548.13 |