Title
Crowdmerge: Achieving Optimal Crowdsourcing Quality Management By Sequent Merger
Abstract
Quality management of worker responses is an increasingly important issue in crowdsourcing, which can be a fundamental reference for workload allocation. However, most of the existing solutions to worker response evaluation meet with significant challenges. Part of them are only able to obtain locally optimal results with low accuracy, while the others have to pay a high price to achieve global optimality. In order to tackle these challenges, this paper proposes a solution to worker quality management which is able to obtain optimal evaluation results close to the globally one with acceptable computational overhead. It is proved to be globally optimal results under certain conditions. The basic idea of the approach is to calculate the similarities among the workers according to which the workers can be clustered gradually. The unknown answers (or outputs) of the tasks are predicted from the results obtained by the clustered workers which will further help with the similarity calculation and the clustering among the remaining workers. A framework and detailed schemes are presented, and simulation experiments are conducted to validate the efficacy of the approach.
Year
DOI
Venue
2018
10.1145/3265689.3265714
PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON CROWD SCIENCE AND ENGINEERING (ICCSE 2018)
Keywords
DocType
Citations 
crowdsourcing, quality management, optimization algorithms
Conference
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Yinan Zhang101.35
Li-zhen Cui228271.41
Jiwei Huang317725.99
Chunyan Miao42307195.72