Title
Online Model-Selection And Learning For Nonlinear Estimation Based On Multikernel Adaptive Filtering
Abstract
We study a use of Gaussian kernels with a wide range of scales for nonlinear function estimation. The estimation task can then be split into two sub-tasks: (i) model selection and (ii) learning (parameter estimation) under the selected model. We propose a fully-adaptive and all-in-one scheme that jointly carries out the two sub-tasks based on the multikernel adaptive filtering framework. The task is cast as an asymptotic minimization problem of an instantaneous fidelity function penalized by two types of block l(1)-norm regularizers. Those regularizers enhance the sparsity of the solution in two different block structures, leading to efficient model selection and dictionary refinement. The adaptive generalized forward-backward splitting method is derived to deal with the asymptotic minimization problem. Numerical examples show that the scheme achieves the model selection and learning simultaneously, and demonstrate its striking advantages over the multiple kernel learning (MKL) method called SimpleMKL.
Year
DOI
Venue
2017
10.1587/transfun.E100.A.236
IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES
Keywords
Field
DocType
adaptive filter, reproducing kernels, proximity operator, convex projection
Nonlinear system,Multikernel,Artificial intelligence,Kernel adaptive filter,Adaptive filter,Machine learning,Mathematics,Online model
Journal
Volume
Issue
ISSN
E100A
1
1745-1337
Citations 
PageRank 
References 
0
0.34
37
Authors
2
Name
Order
Citations
PageRank
Osamu Toda131.40
Masahiro Yukawa227230.44