Title
Evolutionary Multiagent Transfer Learning With Model-Based Opponent Behavior Prediction
Abstract
This article embarks a study on multiagent transfer learning (TL) for addressing the specific challenges that arise in complex multiagent systems where agents have different or even competing objectives. Specifically, beyond the essential backbone of a state-of-the-art evolutionary TL framework (eTL), this article presents the novel TL framework with prediction (eTL-P) as an upgrade over existing eTL to endow agents with abilities to interact with their opponents effectively by building candidate models and accordingly predicting their behavioral strategies. To reduce the complexity of candidate models, eTL-P constructs a monotone submodular function, which facilitates to select Top- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${K}$ </tex-math></inline-formula> models from all available candidate models based on their representativeness in terms of behavioral coverage as well as reward diversity. eTL-P also integrates social selection mechanisms for agents to identify their better-performing partners, thus improving their learning performance and reducing the complexity of behavior prediction by reusing useful knowledge with respect to their partners’ mind universes. Experiments based on a partner-opponent minefield navigation task (PO-MNT) have shown that eTL-P exhibits the superiority in achieving higher learning capability and efficiency of multiple agents when compared to the state-of-the-art multiagent TL approaches.
Year
DOI
Venue
2021
10.1109/TSMC.2019.2958846
IEEE Transactions on Systems, Man, and Cybernetics: Systems
Keywords
DocType
Volume
Behavior prediction,evolutionary transfer learning (eTL),monotone submodular model selection,multiagent system (MAS)
Journal
51
Issue
ISSN
Citations 
10
2168-2216
2
PageRank 
References 
Authors
0.36
17
4
Name
Order
Citations
PageRank
Yaqing Hou124.08
Y. S. Ong2877.30
Jing Tang316316.75
Yifeng Zeng441543.27