Name
Abstract | ||
|---|---|---|
In recent years, crowdsourcing has become an effective method in many fields, such as relevance evaluation of search engine results. However, the problems of bad workers and quality control always stand among the major challenges within the realm. Based on our experiments carried out in TREC 2011 Crowdsourcing track, this paper demonstrates a realtime strategy in recruiting workers and monitoring the quality of their relevance and rank judgments. The effectiveness of our strategy has been verified by empirical results. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1109/ICNIDC.2012.6418811 | "IC-NIDC |
Keywords | Field | DocType |
quality control,recruitment,relevance feedback,trec 2011 crowdsourcing track,crowdsourcing relevance evaluation,information retrieval,rank judgment monitoring,real-time quality control,relevance quality monitoring,search engine results,worker recruitment,crowdsourcing,real-time,relevance assessment | Search engine,Relevance feedback,Information retrieval,Realm,Effective method,Computer science,Crowdsourcing | Conference |
ISBN | Citations | PageRank |
978-1-4673-2201-0 | 3 | 0.45 |
References | Authors | |
3 | 4 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Tao Xia | 1 | 3 | 0.79 |
| Chuang Zhang | 2 | 13 | 3.32 |
| Jingjing Xie | 3 | 10 | 1.70 |
| Tai Li | 4 | 3 | 1.12 |