Title
Planning under Uncertainty with Weighted State Scenarios.
Abstract
In many planning domains external factors are hard to model using a compact Markovian state. However, long-term dependencies between consecutive states of an environment might exist, which can be exploited during planning. In this paper we propose a scenario representation which enables agents to reason about sequences of future states. We show how weights can be assigned to scenarios, representing the likelihood that scenarios predict future states. Furthermore, we present a model based on a Partially Observable Markov Decision Process (POMDP) to reason about state scenarios during planning. In experiments we show how scenarios and our POMDP model can be used in the context of smart grids and stock markets, and we show that our approach outperforms other methods for decision making in these domains.
Year
Venue
DocType
2015
UAI
Conference
ISBN
Citations 
PageRank 
978-0-9966431-0-8
2
0.38
References 
Authors
12
2
Name
Order
Citations
PageRank
Erwin Walraven133.10
Matthijs T.J. Spaan286363.84