Title
Competitive And Online Piecewise Linear Classification
Abstract
In this paper, we study the binary classification problem in machine learning and introduce a novel classification algorithm based on the "Context Tree Weighting Method". The introduced algorithm incrementally learns a classification model through sequential updates in the course of a given data stream, i.e., each data point is processed only once and forgotten after the classifier is updated, and asymptotically achieves the performance of the best piecewise linear classifiers defined by the "context tree". Since the computational complexity is only linear in the depth of the context tree, our algorithm is highly scalable and appropriate for real time processing. We present experimental results on several benchmark data sets and demonstrate that our method provides significant computational improvement both in the test (5 similar to 35x)and training phases (4 0 similar to 1000x), while achieving high classification accuracy in comparison to the SVM with RBF kernel.
Year
DOI
Venue
2013
10.1109/ICASSP.2013.6638299
2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)
Keywords
Field
DocType
Online, Competitive, Classification, Piecewise linear, Context tree, LDA
Mathematical optimization,Binary classification,Radial basis function kernel,Pattern recognition,Computer science,Support vector machine,Context tree weighting,Artificial intelligence,Classifier (linguistics),Linear classifier,Piecewise linear function,Computational complexity theory
Conference
ISSN
Citations 
PageRank 
1520-6149
1
0.35
References 
Authors
5
5
Name
Order
Citations
PageRank
Huseyin Ozkan14010.44
Mehmet A. Donmez2157.44
Ozgun S. Pelvan350.77
Arda Akman4122.26
Suleyman Serdar Kozat512131.32