Abstract | ||
---|---|---|
In this paper, we study the binary classification problem in machine learning and introduce a novel classification algorithm based on the "Context Tree Weighting Method". The introduced algorithm incrementally learns a classification model through sequential updates in the course of a given data stream, i.e., each data point is processed only once and forgotten after the classifier is updated, and asymptotically achieves the performance of the best piecewise linear classifiers defined by the "context tree". Since the computational complexity is only linear in the depth of the context tree, our algorithm is highly scalable and appropriate for real time processing. We present experimental results on several benchmark data sets and demonstrate that our method provides significant computational improvement both in the test (5 similar to 35x)and training phases (4 0 similar to 1000x), while achieving high classification accuracy in comparison to the SVM with RBF kernel. |
Year | DOI | Venue |
---|---|---|
2013 | 10.1109/ICASSP.2013.6638299 | 2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) |
Keywords | Field | DocType |
Online, Competitive, Classification, Piecewise linear, Context tree, LDA | Mathematical optimization,Binary classification,Radial basis function kernel,Pattern recognition,Computer science,Support vector machine,Context tree weighting,Artificial intelligence,Classifier (linguistics),Linear classifier,Piecewise linear function,Computational complexity theory | Conference |
ISSN | Citations | PageRank |
1520-6149 | 1 | 0.35 |
References | Authors | |
5 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Huseyin Ozkan | 1 | 40 | 10.44 |
Mehmet A. Donmez | 2 | 15 | 7.44 |
Ozgun S. Pelvan | 3 | 5 | 0.77 |
Arda Akman | 4 | 12 | 2.26 |
Suleyman Serdar Kozat | 5 | 121 | 31.32 |