Name
Abstract | ||
|---|---|---|
Crowdsourcing is an effective method to obtain large databases of manually-labeled images, which is especially important for image understanding with supervised machine learning algorithms. However, for several kinds of tasks regarding image labeling, e.g., dog breed recognition, it is hard to achieve high-quality results. Therefore, further optimizing crowdsourcing workflow mainly involves task allocation and result inference. For task allocation, we design a two-round crowdsourcing framework, which contains a smart decision mechanism based on information entropy to determine whether to perform the second round task allocation. Regarding result inference, after quantifying the similarity of all labels, two graphical models are proposed to describe the labeling process and corresponding inference algorithms are designed to further improve the result quality of image labeling. Extensive experiments on real-world tasks in Crowdflower and synthesis datasets were conducted. The experimental results demonstrate the superiority of these methods in comparison with state-of-the-art methods. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1007/s11390-017-1770-7 | J. Comput. Sci. Technol. |
Keywords | Field | DocType |
image labeling, crowdsourcing, information entropy, label similarity | Inference,Effective method,Crowdsourcing,Computer science,Artificial intelligence,Graphical model,Workflow,Entropy (information theory),Machine learning,Distributed computing,Image labeling | Journal |
Volume | Issue | ISSN |
32 | 5 | 1000-9000 |
Citations | PageRank | References |
7 | 0.45 | 21 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yili Fang | 1 | 39 | 4.41 |
| Hailong Sun | 2 | 680 | 64.83 |
| Pengpeng Chen | 3 | 123 | 17.75 |
| Ting Deng | 4 | 8 | 3.52 |