Title
Learning to coordinate in complex networks
Abstract
Designing an adaptive multi-agent system often requires the specification of interaction patterns between the different agents. To date, it remains unclear to what extent such interaction patterns influence the dynamics of the learning mechanisms inherent to each agent in the system. Here, we address this fundamental problem, both analytically and via computer simulations, examining networks of agents that engage in stag-hunt games with their neighbors and thereby learn to coordinate their actions. We show that the specific network topology does not affect the game strategy the agents learn on average. Yet, network features such as heterogeneity and clustering effectively determine how this average game behavior arises and how it manifests itself. Network heterogeneity induces variation in learning speed, whereas network clustering results in the emergence of clusters of agents with similar strategies. Such clusters also form when the network structure is not predefined, but shaped by the agents themselves. In that case, the strategy of an agent may become correlated with that of its neighbors on the one hand, and with its degree on the other hand. Here, we show that the presence of such correlations drastically changes the overall learning behavior of the agents. As such, our work provides a clear-cut picture of the learning dynamics associated with networks of agents trying to optimally coordinate their actions.
Year
DOI
Venue
2010
10.1177/1059712310384282
Adaptive Behaviour
Keywords
Field
DocType
network heterogeneity,network structure,specific network topology,game strategy,adaptive multi-agent system,different agent,average game behavior,overall learning behavior,complex network,similar strategy,interaction pattern,evolutionary game theory,network topology,complex networks,multi agent system,computer simulation
Network formation,Learning automata,Computer science,Network simulation,Interaction network,Network topology,Complex network,Artificial intelligence,Evolutionary game theory,Cluster analysis,Machine learning
Journal
Volume
Issue
ISSN
18
5
1059-7123
Citations 
PageRank 
References 
7
0.60
7
Authors
5
Name
Order
Citations
PageRank
Sven Van Segbroeck1253.66
Steven De Jong210512.26
Ann Nowé3971123.04
Francisco C Santos411530.48
Tom Lenaerts527653.44