Title
The Daemo Crowdsourcing Marketplace.
Abstract
The success of crowdsourcing markets is dependent on a strong foundation of trust between workers and requesters. In current marketplaces, workers and requesters are often unable to trust each other's quality, and their mental models of tasks are misaligned due to ambiguous instructions or confusing edge cases. This breakdown of trust typically arises from (1) flawed reputation systems which do not accurately reflect worker and requester quality, and from (2) poorly designed tasks. In this demo, we present how Boomerang and Prototype Tasks, the fundamental building blocks of the Daemo crowdsourcing marketplace, help restore trust between workers and requesters. Daemo's Boomerang reputation system incentivizes alignment between opinion and ratings by determining the likelihood that workers and requesters will work together in the future based on how they rate each other. Daemo's Prototype tasks require that new tasks go through a feedback iteration phase with a small number of workers so that requesters can revise their instructions and task designs before launch.
Year
DOI
Venue
2017
10.1145/3022198.3023270
CSCW Companion
Keywords
Field
DocType
Crowdsourcing Markets, Trust
Data science,World Wide Web,Reputation system,Computer science,Crowdsourcing,Knowledge management,Reputation
Conference
Citations 
PageRank 
References 
2
0.36
5
Authors
27