The Generalized Complex Kernel Affine Projection Algorithms

The complex kernel adaptive filter (CKAF) has been widely applied to the complex-valued nonlinear problem in signal processing and machine learning. However, most of the CKAF applications involve the complex kernel least mean square (CKLMS) algorithms, which work in a pure complex or complexified reproducing kernel Hilbert space (RKHS). In this paper, we propose the generalized complex kernel affine projection (GCKAP) algorithms in the widely linear complex-valued RKHS (WL-RKHS). The proposed algorithms have two main notable features. One is that they provide a complete solution for both circular and non-circular complex nonlinear problems and show many performance improvements over the CKAP algorithms. The other is that the GCKAP algorithms inherit the simplicity of the CKLMS algorithm while reducing its gradient noise and boosting its convergence. The second-order statistical characteristics of WL-RKHS have also been developed. An augmented Gram matrix consists of a standard Gram matrix and a pseudo-Gram matrix. This decomposition provides more underlying information when the real and imaginary parts of the signal are correlated and learning is independent. In addition, some online sparsification criteria are compared comprehensively in the GCKAP algorithms, including the novelty criterion, the coherence criterion, and the angle criterion. Finally, two nonlinear channel equalization experiments with non-circular complex inputs are presented to illustrate the performance improvements of the proposed algorithms.

[1]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[2]  Sergios Theodoridis,et al.  The Augmented Complex Kernel LMS , 2011, IEEE Transactions on Signal Processing.

[3]  Shiyuan Wang,et al.  Kernel Least Mean Square Based on the Nyström Method , 2018, Circuits, Systems, and Signal Processing.

[4]  Tokunbo Ogunfunmi,et al.  On the complex Kernel-based adaptive filter , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[5]  L. Trefethen,et al.  Numerical linear algebra , 1997 .

[6]  Weifeng Liu,et al.  Kernel Adaptive Filtering: A Comprehensive Introduction , 2010 .

[7]  Weifeng Liu,et al.  Kernel Affine Projection Algorithms , 2008, EURASIP J. Adv. Signal Process..

[8]  Masahiro Yukawa,et al.  Adaptive Nonlinear Estimation Based on Parallel Projection Along Affine Subspaces in Reproducing Kernel Hilbert Space , 2015, IEEE Transactions on Signal Processing.

[9]  Gene H. Golub,et al.  Matrix computations , 1983 .

[10]  Rodrigo C. de Lamare,et al.  Adaptive detection using widely linear processing with data reusing for DS-CDMA systems , 2006 .

[11]  Xiaoming Chen,et al.  The Kernel Conjugate Gradient Algorithms , 2018, IEEE Transactions on Signal Processing.

[12]  Masahiro Yukawa,et al.  Multikernel Adaptive Filtering , 2012, IEEE Transactions on Signal Processing.

[13]  Juan José Murillo-Fuentes,et al.  Widely Linear Complex-Valued Kernel Methods for Regression , 2016, IEEE Transactions on Signal Processing.

[14]  Paul Honeine,et al.  Online Prediction of Time Series Data With Kernels , 2009, IEEE Trans. Signal Process..

[15]  Badong Chen,et al.  Mean square convergence analysis for kernel least mean square algorithm , 2012, Signal Process..

[16]  Tokunbo Ogunfunmi,et al.  Analysis of the convergence behavior of the complex Gaussian kernel LMS algorithm , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[17]  Nanning Zheng,et al.  Kernel least mean square with adaptive kernel size , 2014, Neurocomputing.

[18]  L. Scharf,et al.  Statistical Signal Processing of Complex-Valued Data: The Theory of Improper and Noncircular Signals , 2010 .

[19]  Andreas Antoniou,et al.  Affine-Projection-Like Adaptive-Filtering Algorithms Using Gradient-Based Step Size , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  José Luis Rojo-Álvarez,et al.  Digital Signal Processing with Kernel Methods , 2018 .

[21]  Sergios Theodoridis,et al.  The Complex Gaussian Kernel LMS Algorithm , 2010, ICANN.

[22]  Stefanos Zafeiriou,et al.  Principal Component Analysis With Complex Kernel: The Widely Linear Model , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Badong Chen,et al.  Quantized Kernel Least Mean Square Algorithm , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Charles A. Micchelli,et al.  On Learning Vector-Valued Functions , 2005, Neural Computation.

[25]  Yuqi Liu,et al.  A Reduced Gaussian Kernel Least-Mean-Square Algorithm for Nonlinear Adaptive Signal Processing , 2019, Circuits Syst. Signal Process..

[26]  Danilo P. Mandic,et al.  An augmented affine projection algorithm for the filtering of noncircular complex signals , 2010, Signal Process..

[27]  Marc Moonen,et al.  Nonlinear Acoustic Echo Cancellation Based on a Sliding-Window Leaky Kernel Affine Projection Algorithm , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[28]  Vince D. Calhoun,et al.  A multiple kernel learning approach to perform classification of groups from complex-valued fMRI data analysis: Application to schizophrenia , 2014, NeuroImage.

[29]  Badong Chen,et al.  Kernel Kalman Filtering With Conditional Embedding and Maximum Correntropy Criterion , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[30]  Kazuhiko Ozeki Theory of Affine Projection Algorithms for Adaptive Filtering , 2015 .

[31]  Sotirios A. Tsaftaris,et al.  The Generalized Complex Kernel Least-Mean-Square Algorithm , 2019, IEEE Transactions on Signal Processing.

[32]  Peter J. Schreier,et al.  A Unifying Discussion of Correlation Analysis for Complex Random Vectors , 2008, IEEE Transactions on Signal Processing.

[33]  Miguel Lázaro-Gredilla,et al.  Kernel Recursive Least-Squares Tracker for Time-Varying Regression , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Louis L. Scharf,et al.  Statistical Signal Processing of Complex-Valued Data: Complex random vectors , 2010 .

[35]  Sergios Theodoridis,et al.  Adaptive Learning in Complex Reproducing Kernel Hilbert Spaces Employing Wirtinger's Subgradients , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Weifeng Liu,et al.  The Kernel Least-Mean-Square Algorithm , 2008, IEEE Transactions on Signal Processing.

[37]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[38]  Hai Quang Dam,et al.  Deleted DOI: Postfiltering Using Multichannel Spectral Estimation in Multispeaker Environments , 2008 .

[39]  Zongze Wu,et al.  Kernel recursive maximum correntropy , 2015, Signal Process..

[40]  Sergios Theodoridis,et al.  Ieee Transactions on Signal Processing Extension of Wirtinger's Calculus to Reproducing Kernel Hilbert Spaces and the Complex Kernel Lms , 2022 .