Title
Dynamic estimation of worker reliability in crowdsourcing for regression tasks: Making it work.
Abstract
•We propose DER3, a novel approach to estimate worker reliability in crowdsourcing dynamically.•Constant rater availability is not required.•A large number of tasks with correct answers known in advance is not required.•DER3 is specifically suited for regression tasks, but can also be used in different settings.•DER3 leads to the results of high accuracy and low costs in different application domains.
Year
DOI
Venue
2014
10.1016/j.eswa.2014.04.012
Expert Systems with Applications
Keywords
Field
DocType
Supervised machine learning,Crowdsourcing,Worker reliability,Multi-armed bandits,Emotion recognition
Data mining,Binary classification,Regression,Emotion recognition,Computer science,Crowdsourcing,Artificial intelligence,Machine learning
Journal
Volume
Issue
ISSN
41
14
0957-4174
Citations 
PageRank 
References 
14
0.56
57
Authors
3
Name
Order
Citations
PageRank
Alexey Tarasov1283.54
Sarah Jane Delany244629.95
Brian Mac Namee312224.28