Title
Information Elicitation from Rowdy Crowds
Abstract
ABSTRACT We initiate the study of information elicitation mechanisms for a crowd containing both self-interested agents, who respond to incentives, and adversarial agents, who may collude to disrupt the system. Our mechanisms work in the peer prediction setting where ground truth need not be accessible to the mechanism or even exist. We provide a meta-mechanism that reduces the design of peer prediction mechanisms to a related robust learning problem. The resulting mechanisms are ϵ-informed truthful, which means truth-telling is the highest paid ϵ-Bayesian Nash equilibrium (up to ϵ-error) and pays strictly more than uninformative equilibria. The value of ϵ depends on the properties of robust learning algorithm, and typically limits to 0 as the number of tasks and agents increase. We show how to use our meta-mechanism to design mechanisms with provable guarantees in two important crowdsourcing settings even when some agents are self-interested and others are adversarial.
Year
DOI
Venue
2021
10.1145/3442381.3449840
International World Wide Web Conference
Keywords
DocType
Citations 
information elicitation, crowdscourcing, robust algorithms
Conference
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Grant Schoenebeck150939.48
Fang-Yi Yu246.57
Yichi Zhang300.34