Title
Online Learning of Nash Equilibria in Congestion Games.
Abstract
We study the repeated, nonatomic congestion game, in which multiple populations of players share resources and make, at each iteration, a decentralized decision on which resources to utilize. We investigate the following question: given a model of how individual players update their strategies, does the resulting dynamics of strategy profiles converge to the set of Nash equilibria of the one-shot game? We consider in particular a model in which players update their strategies using algorithms with sublinear discounted regret. We show that the resulting sequence of strategy profiles converges to the set of Nash equilibria in the sense of Cesaro means. However, convergence of the actual sequence is not guaranteed in general. We show that it can be guaranteed for a class of algorithms with a sublinear discounted regret and which satisfy an additional condition. We call such algorithms AREP (approximate replicator) algorithms, as they can be interpreted as a discrete-time approximation of the replicator equation, which models the continuous-time evolution of population strategies, and which is known to converge for the class of congestion games.
Year
DOI
Venue
2015
10.1137/140980685
SIAM JOURNAL ON CONTROL AND OPTIMIZATION
Keywords
Field
DocType
online learning,population dynamics,regret minimization,congestion games,nash equilibria
Sublinear function,Convergence (routing),Coordination game,Mathematical optimization,Congestion game,Mathematical economics,Epsilon-equilibrium,Regret,Best response,Nash equilibrium,Mathematics
Journal
Volume
Issue
ISSN
53
2
0363-0129
Citations 
PageRank 
References 
9
0.62
0
Authors
3
Name
Order
Citations
PageRank
Walid Krichene110814.02
Benjamin Drighès2100.98
Alexandre M. Bayen31250137.72