Paper Info
Title
Online learning with sparse labels.
Abstract
In this paper, we consider an online learning scenario where the instances arrive sequentially with partly revealed labels. We assume that the labels of instances are revealed randomly according to some distribution, eg, Bernoulli distribution. Three specific algorithms based on different inspirations are developed. The first one performs the idea of Estimated gradient for which a strict high-probability regret guarantee in scale of & xd5;(T/p) can be derived, when the distributing parameter p is revealed. An empirical version is also developed for cases where the learner has to learn the parameter p when it is not revealed. Experiments on several benchmark data sets show the feasibility of the proposed method. To further improve the performance, two kinds of aggressive algorithms are presented. The first one is based on the idea of instances recalling, which tries to get the full use of the labeled instances. The second one is based on the idea of labels learning, and it tries to learn the labels for unlabeled instances. In particular, it includes the step of online co-learning, which aims to learn the labels, and the step of weighted voting, which aims to make the final decision. Empirical results confirm the positive effects of the two aggressive algorithms.
Year
DOI
Venue
2019
10.1002/cpe.4480
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
Keywords
DocType
Volume
gradient estimation,instances recalling,labels learning,online learning,sparse labels
Journal
31.0
Issue
ISSN
Citations 
SP23.0
1532-0626
0
PageRank 
References 
Authors
0.34
4
3
Name
Order
Citations
PageRank
Wenwu He1735.93
Fumin Zou237.16
Quan Liang300.34