Title
Deep kernel: learning kernel function from data using deep neural network.
Abstract
Kernel function implicitly maps data from its original space to a higher dimensional feature space. Kernel based machine learning algorithms are typically applied to data that is not linearly separable in its original space. Although kernel methods are among the most elegant part of machine learning, it is challenging for users to define or select a proper kernel function with optimized parameter settings for their data. In this paper, we propose a novel method called Deep Kernel that can automatically learn a kernel function from data using deep learning. The deep kernel is currently utilized in classification, and dimension reduction and visualization. For the classification task, we evaluate the deep kernel method by comparing its performance with the optimized Gaussian kernels, both using support vector machines as the decision model, on different types of datasets. The experimental results show that the proposed deep kernel method outperforms the traditional methods with Gaussian kernels on most of the data sets. For the dimension reduction and visualization task, the deep kernel is used along with kernel PCA. The results are also compared and contrasted with using the RBF kernel with multiple parameters. The deep kernel is shown to be more powerful in dimension reduction and visualization than the RBF kernel.
Year
DOI
Venue
2016
10.1145/3006299.3006312
Proceedings of the 3rd IEEE/ACM International Conference on Big Data Computing, Applications and Technologies
Keywords
Field
DocType
Deep Kernel, Deep Learning, Support Vector Machines, Kernel Methods, Classification, Dimension reduction, Visualization
Data mining,Radial basis function kernel,Computer science,Kernel principal component analysis,Tree kernel,Polynomial kernel,Artificial intelligence,String kernel,Pattern recognition,Kernel embedding of distributions,Variable kernel density estimation,Machine learning,Kernel (statistics)
Conference
ISBN
Citations 
PageRank 
978-1-5090-4468-9
0
0.34
References 
Authors
8
4
Name
Order
Citations
PageRank
Linh Le102.03
Jie Hao217538.33
Ying Xie34714.48
Jennifer L. Priestley431.41