Title
A Simple Unlearning Framework for Online Learning Under Concept Drifts.
Abstract
Real-world online learning applications often face data coming from changing target functions or distributions. Such changes, called the concept drift, degrade the performance of traditional online learning algorithms. Thus, many existing works focus on detecting concept drift based on statistical evidence. Other works use sliding window or similar mechanisms to select the data that closely reflect current concept. Nevertheless, few works study how the detection and selection techniques can be combined to improve the learning performance. We propose a novel framework on top of existing online learning algorithms to improve the learning performance under concept drifts. The framework detects the possible concept drift by checking whether forgetting some older data may be helpful, and then conduct forgetting through a step called unlearning. The framework effectively results in a dynamic sliding window that selects some data flexibly for different kinds of concept drifts. We design concrete approaches from the framework based on three popular online learning algorithms. Empirical results show that the framework consistently improves those algorithms on ten synthetic data sets and two real-world data sets.
Year
DOI
Venue
2016
10.1007/978-3-319-31753-3_10
ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2016, PT I
Keywords
Field
DocType
Online learning,Concept drift
Online learning,Forgetting,Data set,Sliding window protocol,Computer science,Concept drift,Artificial intelligence,Synthetic data sets,Machine learning
Conference
Volume
ISSN
Citations 
9651
0302-9743
0
PageRank 
References 
Authors
0.34
9
2
Name
Order
Citations
PageRank
Sheng-Chi You100.34
Hsuan-Tien Lin282974.77