Title
Extension of Wirtinger's Calculus to Reproducing Kernel Hilbert Spaces and the Complex Kernel LMS
Abstract
Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the reproducing kernel Hilbert space (RKHS). However, so far, the emphasis has been on batch techniques. It is only recently, that online techniques have been considered in the context of adaptive signal processing tasks. Moreover, these efforts have only been focussed on real valued data sequences. To the best of our knowledge, no adaptive kernel-based strategy has been developed, so far, for complex valued signals. Furthermore, although the real reproducing kernels are used in an increasing number of machine learning problems, complex kernels have not, yet, been used, in spite of their potential interest in applications that deal with complex signals, with Communications being a typical example. In this paper, we present a general framework to attack the problem of adaptive filtering of complex signals, using either real reproducing kernels, taking advantage of a technique called complexification of real RKHSs, or complex reproducing kernels, highlighting the use of the complex Gaussian kernel. In order to derive gradients of operators that need to be defined on the associated complex RKHSs, we employ the powerful tool of Wirtinger's Calculus, which has recently attracted attention in the signal processing community. Wirtinger's calculus simplifies computations and offers an elegant tool for treating complex signals. To this end, in this paper, the notion of Wirtinger's calculus is extended, for the first time, to include complex RKHSs and use it to derive several realizations of the complex kernel least-mean-square (CKLMS) algorithm. Experiments verify that the CKLMS offers significant performance improvements over several linear and nonlinear algorithms, when dealing with nonlinearities.
Year
DOI
Venue
2010
10.1109/TSP.2010.2096420
Clinical Orthopaedics and Related Research
Keywords
DocType
Volume
Gaussian processes,Hilbert spaces,adaptive filters,adaptive signal processing,differentiation,least mean squares methods,CKLMS algorithm,Wirtinger calculus,adaptive filtering,adaptive signal processing,complex Gaussian kernel,complex kernel LMS,complex kernel least-mean-square algorithm,complex reproducing kernel,complex valued signal,kernel Hilbert space,mathematical tool,nonlinear processing,real RKHS complexification,real valued data sequence,signal processing community,Complex valued nonlinear adaptive filters,Wirtinger's calculus,kernel adaptive filtering,reproducing kernel Hilbert spaces
Journal
59
Issue
ISSN
Citations 
3
1053-587X
70
PageRank 
References 
Authors
2.81
24
2
Name
Order
Citations
PageRank
Pantelis Bouboulis117111.05
Sergios Theodoridis21353106.97