Name
Abstract | ||
|---|---|---|
Learning vector quantization (LVQ) constitutes a powerful and intuitive method for adaptive nearest prototype classification. However, original LVQ has been introduced based on heuristics and numerous modifications exist to achieve better convergence and stability. Recently, a mathematical foundation by means of a cost function has been proposed which, as a limiting case, yields a learning rule similar to classical LVQ2.1. It also motivates a modification which shows better stability. However, the exact dynamics as well as the generalization ability of many LVQ algorithms have not been thoroughly investigated so far. Using concepts from statistical physics and the theory of on-line learning, we present a mathematical framework to analyse the performance of different LVQ algorithms in a typical scenario in terms of their dynamics, sensitivity to initial conditions, and generalization ability. Significant differences in the algorithmic stability and generalization ability can be found already for slightly different variants of LVQ. We study five LVQ algorithms in detail: Kohonen's original LVQ1, unsupervised vector quantization (VQ), a mixture of VQ and LVQ, LVQ2.1, and a variant of LVQ which is based on a cost function. Surprisingly, basic LVQ1 shows very good performance in terms of stability, asymptotic generalization ability, and robustness to initializations and model parameters which, in many cases, is superior to recent alternative proposals. |
Year | DOI | Venue |
|---|---|---|
2006 | 10.1016/j.neunet.2006.05.010 | Neural Networks |
Keywords | DocType | Volume |
different lvq algorithm,asymptotic generalization ability,vq,order parameters,lfm,lvq +,basic lvq1,lvq algorithm,statistical physics approach,online learning,generalization ability,lvq1,better stability,lvq+,thermodynamic limit,on-line learning,performance analysis,lvq2.1,cost function,algorithmic stability,original lvq,learning vector quantization,statistical physics,lvq,initial condition | Journal | 19 |
Issue | ISSN | Citations |
6-7 | 0893-6080 | 7 |
PageRank | References | Authors |
0.91 | 10 | 3 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Anarta Ghosh | 1 | 156 | 13.81 |
| Michael Biehl | 2 | 784 | 62.50 |
| Barbara Hammer | 3 | 2383 | 181.34 |