Paper Info
Title
A family of large margin linear classifiers and its application in dynamic environments
Abstract
Real-time prediction problems pose a challenge to machine learning algorithms because learning must be fast, the set of classes may be changing, and the relevance of some features to each class may be changing. To learn robust classifiers in such nonstationary environments, it is essential not to assign too much weight to any single feature. We address this problem by combining regularization mechanisms with online large-margin learning algorithms. We prove bounds on their error and show that removing features with small weights has little influence on prediction accuracy, suggesting that these methods exhibit feature selection ability. We show that such regularized learning algorithms automatically decrease the influence of older training instances and focus on the more recent ones. This makes them especially attractive in dynamic environments. We evaluate our algorithms through experimental results on real data sets and through experiments with an online activity recognition system. The results show that these regularized large-margin methods adapt more rapidly to changing distributions and achieve lower overall error rates than state-of-the-art methods. Copyright © 2009 Wiley Periodicals, Inc. Statistical Analysis and Data Mining 2: 328-345, 2009
Year
DOI
Venue
2009
10.1002/sam.v2:5/6
Statistical Analysis and Data Mining
Keywords
DocType
Volume
prediction accuracy,online learning,real-time problems,methods exhibit feature selection,linear classifier,regularized large-margin method,online large-margin,large margin,single feature,real-time prediction problem,data mining,adaptive algorithms.,classification,feature selec- tion,overall error rate,online activity recognition system,dynamic environment,regularized learning,feature selection,real time,activity recognition,machine learning
Conference
2
Issue
Citations 
PageRank 
5‐6
0
0.34
References 
Authors
24
2
Name
Order
Citations
PageRank
Jianqiang Shen123617.86
Thomas G. Dietterich293361722.57