Title
Learning Reciprocity in Complex Sequential Social Dilemmas.
Abstract
Reciprocity is an important feature of human social interaction and underpins our cooperative nature. What is more, simple forms of reciprocity have proved remarkably resilient in matrix game social dilemmas. Most famously, the tit-for-tat strategy performs very well in tournaments of Prisoneru0027s Dilemma. Unfortunately this strategy is not readily applicable to the real world, in which options to cooperate or defect are temporally and spatially extended. Here, we present a general online reinforcement learning algorithm that displays reciprocal behavior towards its co-players. We show that it can induce pro-social outcomes for the wider group when learning alongside selfish agents, both in a $2$-player Markov game, and in $5$-player intertemporal social dilemmas. We analyse the resulting policies to show that the reciprocating agents are strongly influenced by their co-playersu0027 behavior.
Year
Venue
DocType
2019
arXiv: Multiagent Systems
Journal
Volume
Citations 
PageRank 
abs/1903.08082
0
0.34
References 
Authors
11
5
Name
Order
Citations
PageRank
Tom Eccles1175.77
Edward Hughes272.52
János Kramár300.34
Steven Wheelwright400.34
Leibo, Joel Z.529921.41