Title
Learning dynamics and robustness of vector quantization and neural gas
Abstract
Various alternatives have been developed to improve the winner-takes-all (WTA) mechanism in vector quantization, including the neural gas (NG). However, the behavior of these algorithms including their learning dynamics, robustness with respect to initialization, asymptotic results, etc. has only partially been studied in a rigorous mathematical analysis. The theory of on-line learning allows for an exact mathematical description of the training dynamics in model situations. We demonstrate using a system of three competing prototypes trained from a mixture of Gaussian clusters that the NG can improve convergence speed and achieves robustness to initial conditions. However, depending on the structure of the data, the NG does not always obtain the best asymptotic quantization error.
Year
DOI
Venue
2008
10.1016/j.neucom.2007.11.022
Neurocomputing
Keywords
Field
DocType
convergence speed,asymptotic quantization error,model situation,gaussian cluster,vector quantization,rigorous mathematical analysis,exact mathematical description,neural gas,initial condition,on-line learning,asymptotic result,quantization error,clustering,mixture of gaussians,mathematical analysis,winner take all
Convergence (routing),Pattern recognition,Computer science,Learning vector quantization,Robustness (computer science),Vector quantization,Gaussian,Artificial intelligence,Initialization,Quantization (signal processing),Machine learning,Neural gas
Journal
Volume
Issue
ISSN
71
7-9
Neurocomputing
Citations 
PageRank 
References 
8
0.75
7
Authors
4
Name
Order
Citations
PageRank
Aree Witoelar1274.45
Michael Biehl278462.50
Anarta Ghosh315613.81
Barbara Hammer42383181.34