Title
Selective ensemble-based online adaptive deep neural networks for streaming data with concept drift
Abstract
Concept drift is an important issue in the field of streaming data mining. However, how to maintain real-time model convergence in a dynamic environment is an important and difficult problem. In addition, the current methods have limited ability to deal with the problem of streaming data classification for complex nonlinear problems. To solve these problems, a selective ensemble-based online adaptive deep neural network (SEOA) is proposed to address concept drift. First, the adaptive depth unit is constructed by combining shallow features with deep features and adaptively controls the information flow in the neural network according to changes in streaming data at adjacent moments, which improves the convergence of the online deep learning model. Then, the adaptive depth units of different layers are regarded as base classifiers for ensemble and weighted dynamically according to the loss of each classifier. In addition, a dynamic selection of base classifiers is adopted according to the fluctuation of the streaming data to achieve a balance between stability and adaptability. The experimental results show that the SEOA can effectively contend with different types of concept drift and has good robustness and generalization.
Year
DOI
Venue
2021
10.1016/j.neunet.2021.06.027
Neural Networks
Keywords
DocType
Volume
Concept drift,Selective ensemble,Deep neural networks,Online learning,Adaptive method
Journal
142
Issue
ISSN
Citations 
1
0893-6080
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Husheng Guo1232.50
Shuai Zhang23711.44
Wenjian Wang313717.90