Paper Info
Title
Personalized Feedback Versus Money: The Effect on Reliability of Subjective Data in Online Experimental Platforms.
Abstract
We compared the data reliability on a subjective task from two platforms: Amazon's Mechanical Turk (MTurk) and LabintheWild. MTurk incentivizes participants with financial compensation while LabintheWild provides participants with personalized feedback. LabintheWild was found to produce higher data reliability than MTurk. Our findings suggested that online experiment platforms providing feedback in exchange for study participation could produce more reliable data in subjective preference tasks than those offering financial compensation.
Year
DOI
Venue
2017
10.1145/3022198.3026339
CSCW Companion
Keywords
Field
DocType
Crowdsourcing, Online Experimentation, Mechanical Turk, Compensation, Motivation, Incentives, Data Quality
Data quality,Incentive,Computer science,Crowdsourcing,Data reliability,Human–computer interaction,Financial compensation
Conference
Citations 
PageRank 
References 
0
0.34
3
Authors
3
Name
Order
Citations
PageRank
Teng Ye162.46
Katharina Reinecke249740.37
Lionel Robert, Jr.334732.07