Title
Learning and Feature Selection under Budget Constraints in Crowdsourcing.
Abstract
The cost of data acquisition limits the amount of labeled data available for machine learning algorithms, both at the training and the testing phase. This problem is further exacerbated in real-world crowdsourcing applications where labels are aggregated from multiple noisy answers. We tackle classification problems where the underlying feature labels are unknown to the algorithm and a (noisy) label of the desired feature can be acquired at a fixed cost. This problem has two types of budget constraints - the total cost of feature labels available for learning at the training phase, and the cost of features to use during the testing phase for classification. We propose a novel budgeted learning and feature selection algorithm, B-LEAFS, for jointly tackling this problem in the presence of noise. Experimental evaluation on synthetic and real-world crowdsourcing data demonstrate the practical applicability of our approach.
Year
Venue
Field
2016
HCOMP
Data mining,Budget constraint,Feature selection,Computer science,Crowdsourcing,Data acquisition,Fixed cost,Artificial intelligence,Labeled data,Total cost,Machine learning
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Besmira Nushi112010.98
Adish Singla239733.45
Andreas Krause35822368.37
Donald Kossmann46220603.55