Title
Higher-Order Regularized Kernel CCA
Abstract
Kernel canonical correlation analysis (kernel CCA) is sensitive to the choice of appropriate kernels and associated parameters. To the best of our knowledge there is no general well-founded approach for choosing them. As we demonstrate with Gaussian kernels, the kernel CCA tends to show perfect correlation as the bandwidth parameter of the Gaussian kernel decreases, while it provides inappropriate features with all the data concentrated in a few points. This is caused by the ill-posed ness of the kernel CCA with the 4th order moment of canonical variates becomes large. To overcome this problem, we propose to use constraints on the 4th order moments of canonical variates in addition to the variances. Experiments on synthesized and real world datasets demonstrate that the proposed kernel CCA provides well-posed and robust solution in reasonable ranges of all the hyper parameters.
Year
DOI
Venue
2013
10.1109/ICMLA.2013.76
ICMLA), 2013 12th International Conference
Keywords
Field
DocType
Gaussian processes,higher order statistics,learning (artificial intelligence),4th order moment,Gaussian kernels,canonical variates,higher-order regularized kernel CCA,kernel canonical correlation analysis,machine learning,higher-order regularization,kernel CCA,measure of dependence,robust solution
Radial basis function kernel,Kernel embedding of distributions,Kernel principal component analysis,Polynomial kernel,Artificial intelligence,Kernel method,Variable kernel density estimation,Machine learning,Mathematics,Kernel regression,Kernel (statistics)
Conference
Volume
Citations 
PageRank 
1
1
0.36
References 
Authors
9
2
Name
Order
Citations
PageRank
Md. Ashad Alam1102.91
kenji fukumizu21683158.91