Title
Online Model Selection And Learning By Multikernel Adaptive Filtering
Abstract
We propose an efficient multikernel adaptive filtering algorithm with double regularizers, providing a novel pathway towards online model selection and learning. The task is the challenging nonlinear adaptive filtering under no knowledge about a suitable kernel. Under this limited-knowledge assumption on an underlying model of a system of interest, many possible kernels are employed and one of the regularizers, a block l(1) norm for kernel groups, contributes to selecting a proper model (relevant kernels) in online and adaptive fashion, preventing a nonlinear filter from overfitting to noisy data. The other regularizer is the block l(1) norm for data groups, contributing to updating the dictionary adaptively. As the resulting cost function contains two nonsmooth (but proximable) terms, we approximate the latter regularizer by its Moreau envelope and apply the adaptive proximal forward-backward splitting method to the approximated cost function. Numerical examples show the efficacy of the proposed algorithm.
Year
Venue
Keywords
2013
2013 PROCEEDINGS OF THE 21ST EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO)
kernel adaptive filter, proximity operator, multiple kernels
Field
DocType
Citations 
Kernel (linear algebra),Multikernel,Kernel adaptive filter,Adaptive filter,Artificial intelligence,Overfitting,Nonlinear filter,Variable kernel density estimation,Mathematics,Machine learning,Online model
Conference
10
PageRank 
References 
Authors
0.56
6
2
Name
Order
Citations
PageRank
Masahiro Yukawa127230.44
Ryu-ichiro Ishii2100.56