Title
Approximate solutions for factored Dec-POMDPs with many agents
Abstract
Dec-POMDPs are a powerful framework for planning in multiagent systems, but are provably intractable to solve. Despite recent work on scaling to more agents by exploiting weak couplings in factored models, scalability for unrestricted subclasses remains limited. This paper proposes a factored forward-sweep policy computation method that tackles the stages of the problem one by one, exploiting weakly coupled structure at each of these stages. To enable the method to scale to many agents, we propose a set of approximations: approximation of stages using a sparse interaction structure, bootstrapping off smaller tasks to compute heuristic payoff functions, and employing approximate inference to estimate required probabilities at each stage and to compute the best decision rules. An empirical evaluation shows that the loss in solution quality due to these approximations is small and that the proposed method achieves unprecedented scalability, solving Dec-POMDPs with hundreds of agents.
Year
DOI
Venue
2013
10.5555/2484920.2485010
AAMAS
Keywords
DocType
Citations 
factored model,factored forward-sweep policy computation,approximate solution,approximate inference,unprecedented scalability,multiagent system,factored dec-pomdps,heuristic payoff function,best decision rule,sparse interaction structure,empirical evaluation
Conference
7
PageRank 
References 
Authors
0.46
32
3
Name
Order
Citations
PageRank
Frans A. Oliehoek139740.32
Shimon Whiteson2146099.00
Matthijs T.J. Spaan386363.84