Title
Deep Active Learning for Biased Datasets via Fisher Kernel Self-Supervision
Abstract
Active learning (AL) aims to minimize labeling efforts for data-demanding deep neural networks (DNNs) by selecting the most representative data points for annotation. However, currently used methods are ill-equipped to deal with biased data. The main motivation of this paper is to consider a realistic setting for pool-based semi-supervised AL, where the unlabeled collection of train data is biased. We theoretically derive an optimal acquisition function for AL in this setting. It can be formulated as distribution shift minimization between unlabeled train data and weakly-labeled validation dataset. To implement such acquisition function, we propose a low-complexity method for feature density matching using self-supervised Fisher kernel (FK) as well as several novel pseudo-label estimators. Our FK-based method outperforms state-of-the-art methods on MNIST, SVHN, and ImageNet classification while requiring only 1/10th of processing. The conducted experiments show at least 40% drop in labeling efforts for the biased class-imbalanced data compared to existing methods.
Year
DOI
Venue
2020
10.1109/CVPR42600.2020.00906
CVPR
DocType
Citations 
PageRank 
Conference
3
0.38
References 
Authors
17
4
Name
Order
Citations
PageRank
Denis A. Gudovskiy162.44
Alec Hodgkinson230.72
Takuhiro Yamaguchi362.43
Sotaro Tsukizawa430.72