Title
Crowdsourcing Aggregation With Deep Bayesian Learning
Abstract
In this study, we consider a crowdsourcing classification problem in which labeling information from crowds is aggregated to infer latent true labels. We propose a fully Bayesian deep generative crowdsourcing model (BayesDGC), which combines the strength of deep neural networks (DNNs) on automatic representation learning and the interpretable probabilistic structure encoding of probabilistic graphical models. The model comprises a DNN classifier as a prior for the true labels and a probabilistic model for the annotation generation process. The DNN classifier and annotation generation process share the latent true label variables. To address the inference challenge, we developed a natural-gradient stochastic variational inference, which combines variational message passing for conjugate parameters and stochastic gradient descent for DNN and learns the distribution of latent true labels and workers' confusion matrix via end-to-end training. We illustrated the effectiveness of the proposed model using empirical results on 22 real-world datasets.
Year
DOI
Venue
2021
10.1007/s11432-020-3118-7
SCIENCE CHINA-INFORMATION SCIENCES
Keywords
DocType
Volume
crowdsourcing, classification, fully Bayesian deep generative models, natural gradient, stochastic variational inference
Journal
64
Issue
ISSN
Citations 
3
1674-733X
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Shao-Yuan Li131.06
Sheng-Jun Huang247527.21
Songcan Chen34148191.89