Title
Gauss meets Canadian traveler: shortest-path problems with correlated natural dynamics
Abstract
In a variety of real world problems from robot navigation to logistics, agents face the challenge of path optimization on a graph with unknown edge costs. These settings can be generally formalized as the Canadian Traveler Problems (CTPs) [13]. Although in many applications the edge costs have dependencies resulting from world dynamics, CTPs with such structure have received considerably less attention than those with independent edge costs, largely because the dependence structure is often problem-specific and difficult to state compactly. Yet, in a wide variety of navigation tasks, spatial correlations between edge traversal costs are governed by natural phenomena such as winds, congestion, or ocean currents, which are conveniently described with a well-understood machine learning model --- Gaussian Process (GP). In this article, we propose a synthesis of CTPs and GPs, the Gaussian Traveler Problem (GTP). In GTPs, an agent observes the costs of graph edges when traversing them, and uses the observed costs to adjust its belief over other edges via Gaussian Process updates. Examples of GTP instances include aircraft, traffic, and vessel navigation, to name just a few. Computing optimal agent behavior for a GTP turns out to be equivalent to solving a Partially Observable MDP with continuous observation space. We present an approximate algorithm for solving GTPs with efficient machine-learning and decision-making components, whose design is influenced by the challenges of real-world problems. Despite the intractability of computing an optimal policy, our experiments in the aircraft navigation scenario with real wind data demonstrate that our framework can significantly improve upon state-of-the-art techniques for planning airplane routes.
Year
DOI
Venue
2014
10.5555/2615731.2617421
AAMAS
Keywords
DocType
Citations 
graph edge,shortest-path problem,correlated natural dynamic,gaussian process,edge traversal cost,independent edge cost,vessel navigation,unknown edge cost,canadian traveler,navigation task,aircraft navigation scenario,robot navigation,edge cost
Conference
1
PageRank 
References 
Authors
0.35
11
6
Name
Order
Citations
PageRank
Debadeepta Dey123820.49
Andrey Kolobov234523.07
Rich Caruana34503655.71
Ece Kamar457748.11
Eric Horvitz594021058.25
Ashish Kapoor61833119.72