Title
Efficient active learning of halfspaces: an aggressive approach
Abstract
We study pool-based active learning of half-spaces. We revisit the aggressive approach for active learning in the realizable case, and show that it can be made efficient and practical, while also having theoretical guarantees under reasonable assumptions. We further show, both theoretically and experimentally, that it can be preferable to mellow approaches. Our efficient aggressive active learner of half-spaces has formal approximation guarantees that hold when the pool is separable with a margin. While our analysis is focused on the realizable setting, we show that a simple heuristic allows using the same algorithm successfully for pools with low error as well. We further compare the aggressive approach to the mellow approach, and prove that there are cases in which the aggressive approach results in significantly better label complexity compared to the mellow approach. We demonstrate experimentally that substantial improvements in label complexity can be achieved using the aggressive approach, for both realizable and low-error settings.
Year
DOI
Venue
2013
10.5555/2567709.2567744
ICML
Keywords
DocType
Volume
active learning,margin
Journal
14
Issue
ISSN
Citations 
Issue-in-Progress
Journal of Machine Learning Research, 14(Sep):2487-2519, 2013
3
PageRank 
References 
Authors
0.39
23
3
Name
Order
Citations
PageRank
Alon Gonen11049.76
Sivan Sabato28919.10
Shai Shalev-Shwartz33681276.32