Title
Approximating behavioral equivalence for scaling solutions of I-DIDs
Abstract
Abstract Interactive dynamic influence diagram (I-DID) is a recognized graphical framework for sequential multiagent decision making under uncertainty. I-DIDs concisely represent the problem of how an individual agent should act in an uncertain environment shared with others of unknown types. I-DIDs face the challenge of solving a large number of models that are ascribed to other agents. A known method for solving I-DIDs is to group models of other agents that are behaviorally equivalent. Identifying model equivalence requires solving models and comparing their solutions generally represented as policy trees. Because the trees grow exponentially with the number of decision time steps, comparing entire policy trees becomes intractable, thereby limiting the scalability of previous I-DID techniques. In this article, our specific approaches focus on utilizing partial policy trees for comparison and determining the distance between updated beliefs at the leaves of the trees. We propose a principled way to determine how much of the policy trees to consider, which trades off solution quality for efficiency. We further improve on this technique by allowing the partial policy trees to have paths of differing lengths. We evaluate these approaches in multiple problem domains and demonstrate significantly improved scalability over previous approaches.
Year
DOI
Venue
2016
10.1007/s10115-015-0912-x
Knowledge and Information Systems
Keywords
Field
DocType
Multiagent systems,Decision making,Influence diagrams,Behavioral equivalence
Data mining,Mathematical optimization,Computer science,Multi-agent system,Equivalence (measure theory),Influence diagram,Artificial intelligence,Scaling,Limiting,Machine learning,Scalability
Journal
Volume
Issue
ISSN
49
2
0219-3116
Citations 
PageRank 
References 
1
0.36
29
Authors
6
Name
Order
Citations
PageRank
Yifeng Zeng141543.27
Prashant Doshi292690.23
Yingke Chen3524.78
Yinghui Pan4305.21
Hua Mao511111.53
Muthukumaran Chandrasekaran6324.81