Title
A Regulation Enforcement Solution for Multi-agent Reinforcement Learning.
Abstract
Human behaviors are regularized by a variety of norms or regulations, either to maintain orders or to enhance social welfare. If artificial intelligent (AI) agents make decisions on behalf of human beings, we would hope they can also follow established regulations while interacting with humans or other AI agents. However, it is possible that an AI agent can opt to disobey the regulations for self-interests. This paper attempts to design a mechanism that discourages the agents from not obeying the global regulation setup for every agent. We first introduce the problem Regulation Enforcement and formulate it using reinforcement learning and game theory under the scenario where agents make decisions in complete isolation of other agents. The key idea is that, although we could not alter how defective agents choose to behave, we can, however, leverage the aggregated power of compliant agents to boycott the defective ones. Based on the idea, we proposed a solution to the problem and conducted simulated experiments on two scenarios: Replenishing Resource Management Dilemma and Diminishing Reward Shaping Enforcement, using deep multi-agent reinforcement learning algorithms. We further use empirical game-theoretic analysis to show that how the method alters the resulting empirical payoff matrices in a way that promotes compliance (making mutual compliant a Nash Equilibrium).
Year
DOI
Venue
2019
10.5555/3306127.3332057
arXiv: Computer Science and Game Theory
Keywords
Field
DocType
multi-agent reinforcement learning,empirical game-theoretic analysis,reward shaping
Resource management,Computer science,Risk analysis (engineering),Human behavior,Game theory,Enforcement,Dilemma,Nash equilibrium,Stochastic game,Reinforcement learning,Distributed computing
Journal
Volume
Citations 
PageRank 
abs/1901.10059
0
0.34
References 
Authors
14
4
Name
Order
Citations
PageRank
Fan-Yun Sun120.70
Yen-Yu Chang220.71
Yueh-Hua Wu382.87
Shou-De Lin470684.81