Title | ||
---|---|---|
Evolutionary Multiagent Transfer Learning With Model-Based Opponent Behavior Prediction |
Abstract | ||
---|---|---|
This article embarks a study on multiagent transfer learning (TL) for addressing the specific challenges that arise in complex multiagent systems where agents have different or even competing objectives. Specifically, beyond the essential backbone of a state-of-the-art evolutionary TL framework (eTL), this article presents the novel TL framework with prediction (eTL-P) as an upgrade over existing eTL to endow agents with abilities to interact with their opponents effectively by building candidate models and accordingly predicting their behavioral strategies. To reduce the complexity of candidate models, eTL-P constructs a monotone submodular function, which facilitates to select Top-
<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${K}$ </tex-math></inline-formula>
models from all available candidate models based on their representativeness in terms of behavioral coverage as well as reward diversity. eTL-P also integrates social selection mechanisms for agents to identify their better-performing partners, thus improving their learning performance and reducing the complexity of behavior prediction by reusing useful knowledge with respect to their partners’ mind universes. Experiments based on a partner-opponent minefield navigation task (PO-MNT) have shown that eTL-P exhibits the superiority in achieving higher learning capability and efficiency of multiple agents when compared to the state-of-the-art multiagent TL approaches. |
Year | DOI | Venue |
---|---|---|
2021 | 10.1109/TSMC.2019.2958846 | IEEE Transactions on Systems, Man, and Cybernetics: Systems |
Keywords | DocType | Volume |
Behavior prediction,evolutionary transfer learning (eTL),monotone submodular model selection,multiagent system (MAS) | Journal | 51 |
Issue | ISSN | Citations |
10 | 2168-2216 | 2 |
PageRank | References | Authors |
0.36 | 17 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Yaqing Hou | 1 | 2 | 4.08 |
Y. S. Ong | 2 | 87 | 7.30 |
Jing Tang | 3 | 163 | 16.75 |
Yifeng Zeng | 4 | 415 | 43.27 |