Title
Multi-scale kernels for Nyström based extension schemes.
Abstract
Nonlinear dimensionality reduction methods often include the construction of kernels for embedding the high-dimensional data points. Standard methods for extending the embedding coordinates (such as the Nystrm method) also rely on spectral decomposition of kernels. It is desirable that these kernels capture most of the data sets information using only a few leading modes of the spectrum.In this work we propose multi-scale kernels, which are constructed as combinations of Gaussian kernels, to be used for kernel-based extension schemes. We review the kernels spectral properties and show that their first few modes capture more information compared to the standard Gaussian kernel. Their application is demonstrated on a synthetic data-set and also applied to a real-life example that models daily electricity profiles and predicts the average day-ahead behavior.
Year
DOI
Venue
2018
10.1016/j.amc.2017.02.025
Applied Mathematics and Computation
Keywords
Field
DocType
Dimensionality reduction, Function extension, Kernel methods, Manifold learning
Nyström method,Data point,Mathematical optimization,Data set,Embedding,Dimensionality reduction,Matrix decomposition,Kernel method,Nonlinear dimensionality reduction,Mathematics
Journal
Volume
ISSN
Citations 
319
0096-3003
1
PageRank 
References 
Authors
0.35
9
2
Name
Order
Citations
PageRank
Neta Rabin1225.55
Dalia Fishelov2315.67