Title
ELMVIS+: Fast nonlinear visualization technique based on cosine distance and extreme learning machines.
Abstract
Abstract This paper presents a fast algorithm and an accelerated toolbox 1 for data visualization. The visualization is stated as an assignment problem between data samples and the same number of given visualization points. The mapping function is approximated by an Extreme Learning Machine, which provides an error for a current assignment. This work presents a new mathematical formulation of the error function based on cosine similarity. It provides a closed form equation for a change of error for exchanging assignments between two random samples (called a swap), and an extreme speed-up over the original method even for a very large corpus like the MNIST Handwritten Digits dataset. The method starts from random assignment, and continues in a greedy optimization algorithm by randomly swapping pairs of samples, keeping the swaps that reduce the error. The toolbox speed reaches a million of swaps per second, and thousands of model updates per second for successful swaps in GPU implementation, even for very large dataset like MNIST Handwritten Digits.
Year
Venue
Field
2016
Neurocomputing
Error function,Data visualization,MNIST database,Pattern recognition,Cosine similarity,Extreme learning machine,Computer science,Visualization,Assignment problem,Artificial intelligence,Nonlinear dimensionality reduction,Machine learning
DocType
Volume
Citations 
Journal
205
3
PageRank 
References 
Authors
0.38
23
7
Name
Order
Citations
PageRank
Anton Akusok114310.72
Stephen Baek242.75
Yoan Miche3105454.56
Kaj-Mikael Björk414816.40
Rui Nian515912.18
Paula Lauren6122.50
Amaury Lendasse71876126.03