Title
Crowdsourcing Enumeration Queries: Estimators and Interfaces
Abstract
Hybrid human/computer database systems promise to greatly expand the usefulness of query processing by incorporating the crowd for data gathering and other tasks. Such systems raise many implementation questions. Perhaps the most fundamental issue is that the closed world assumption underlying relational query semantics does not hold in such systems. As a consequence, the meaning of even simple queries can be called into question. Furthermore, query progress monitoring becomes difficult due to non-uniformities in the arrival of crowdsourced data and peculiarities of how people work in crowdsourcing systems. To address these issues, we develop statistical tools that enable users and systems developers to reason about query completeness. These tools can also help drive query execution and crowdsourcing strategies. We evaluate our techniques using experiments on a popular crowdsourcing platform.
Year
DOI
Venue
2015
10.1109/TKDE.2014.2339857
Knowledge and Data Engineering, IEEE Transactions  
Keywords
Field
DocType
database design,modeling and management,user interfaces,database management systems,sociology,data gathering,estimator,interface,crowdsourcing,estimation,statistical analysis
Query optimization,Data mining,Query language,Query expansion,Information retrieval,Computer science,Crowdsourcing,Web query classification,Database design,User interface,Closed-world assumption
Journal
Volume
Issue
ISSN
27
7
1041-4347
Citations 
PageRank 
References 
1
0.34
20
Authors
5
Name
Order
Citations
PageRank
beth trushkowsky110.34
Tim Kraska22226133.57
Michael J. Franklin3174231681.10
purnamrita sarkar410.34
venketaram ramachandran510.34