Title
Non-Deep Active Learning for Deep Neural Networks
Abstract
One way to improve annotation efficiency is active learning. The goal of active learning is to select images from many unlabeled images, where labeling will improve the accuracy of the machine learning model the most. To select the most informative unlabeled images, conventional methods use deep neural networks with a large number of computation nodes and long computation time, but we propose a non-deep neural network method that does not require any additional training for unlabeled image selection. The proposed method trains a task model on labeled images, and then the model predicts unlabeled images. Based on this prediction, an uncertainty indicator is generated for each unlabeled image. Images with a high uncertainty index are considered to have a high information content, and are selected for annotation. Our proposed method is based on a very simple and powerful idea: select samples near the decision boundary of the model. Experimental results on multiple datasets show that the proposed method achieves higher accuracy than conventional active learning methods on multiple tasks and up to 14 times faster execution time from 1.2 x 10(6) s to 8.3 x 10(4) s. The proposed method outperforms the current SoTA method by 1% accuracy on CIFAR-10.
Year
DOI
Venue
2022
10.3390/s22145244
SENSORS
Keywords
DocType
Volume
active learning, annotation, uncertainty sample selection
Journal
22
Issue
ISSN
Citations 
14
1424-8220
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Yasufumi Kawano100.34
Yoshiki Nota200.34
Rinpei Mochizuki300.34
Yoshimitsu Aoki48023.65