Nonlinear Adaptive Filtering with a Family of Kernel Affine Projection Algorithms

In this chapter, the family of kernel affine projection algorithms with coherence criterion is presented. The proportionality principle is translated to the kernel-based version. A new algorithm called Kernel Proportionate Affine Projection Algorithm (KPAPA) is proposed. It is proved that the additional computational increase burden is independent of the order of the algorithm, being dependent only on the order of the kernel expansion. The Dichotomous Coordinate Descent (DCD) method and an example of an efficient implementation of KAPA using DCD are presented. This chapter also discusses the influence of the coherence value, the step size value, and the dictionary size on the performance of KAPA and KPAPA algorithms. The effectiveness of the proposed algorithms and the effect of different parameters are confirmed by computer simulations for nonlinear system identification application.

[1]  Tyseer Aboulnasr,et al.  A robust variable step-size LMS-type algorithm: analysis and simulations , 1997, IEEE Trans. Signal Process..

[2]  Se-Jin Kong,et al.  An Affine Projection Algorithm With Evolving Order , 2009, IEEE Signal Processing Letters.

[3]  Ahmad Taher Azar,et al.  Handbook of Research on Advanced Intelligent Control Engineering and Automation , 2015 .

[4]  Jacob Benesty,et al.  Regularization of the improved proportionate affine projection algorithm , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Wutao Yin,et al.  A Variable Regularization Method for Affine Projection Algorithm , 2010, IEEE Transactions on Circuits and Systems II: Express Briefs.

[6]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[7]  Weifeng Liu,et al.  Fixed-budget kernel recursive least-squares , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  C. K. Michael Tse,et al.  Kernel Affine Projection Sign Algorithms for Combating Impulse Interference , 2013, IEEE Transactions on Circuits and Systems II: Express Briefs.

[9]  Sergios Theodoridis,et al.  Adaptation and Learning over Complex Networks [From the Guest Editors] , 2013, IEEE Signal Process. Mag..

[10]  Theo J. A. de Vries,et al.  Pruning error minimization in least squares support vector machines , 2003, IEEE Trans. Neural Networks.

[11]  Milos Doroslovacki,et al.  Proportionate adaptive algorithms for network echo cancellation , 2006, IEEE Transactions on Signal Processing.

[12]  Johan A. K. Suykens,et al.  Weighted least squares support vector machines: robustness and sparse approximation , 2002, Neurocomputing.

[13]  Weifeng Liu,et al.  The Kernel Least-Mean-Square Algorithm , 2008, IEEE Transactions on Signal Processing.

[14]  Akihiko Sugiyama,et al.  A generalized proportionate variable step-size algorithm for fast changing acoustic environments , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Flah Aymen,et al.  Electrical Motor Parameters Estimator Improved by a Computational Algorithm , 2015 .

[16]  Tarek I. Haweel.  A simple variable step size LMS adaptive algorithm , 2004, Int. J. Circuit Theory Appl..

[17]  Felix Albu.  A PROPORTIONATE AFFINE PROJECTION ALGORITHM USING FAST RECURSIVE FILTERING AND DICHOTOMOUS COORDINAT , 2011 .

[18]  Felix Albu,et al.  The kernel proportionate NLMS algorithm , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[19]  Jie Liu,et al.  Promoting Access to White Rose Research Papers Low-complexity Rls Algorithms Using Dichotomous Coordinate Descent Iterations , 2022 .

[20]  Emad Abu-Shanab,et al.  Reasons Behind IT Project Failure: The Case of Jordan , 2013 .

[21]  Ali H. Sayed,et al.  Variable step-size NLMS and affine projection algorithms , 2004, IEEE Signal Processing Letters.

[22]  Mohan Kumar Pradhan,et al.  Handbook of Research on Manufacturing Process Modeling and Optimization Strategies , 2017 .

[23]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[24]  Sergios Theodoridis,et al.  Special Issue on Advances in Kernel-Based Learning for Signal Processing , 2013 .

[25]  Yoshiki Ogawa,et al.  Fixed order implementation of kernel RLS-DCD adaptive filters , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[26]  Sergios Theodoridis,et al.  Special Issue on Advances in Kernel-Based Learning for Signal Processing [From the Guest Editors] , 2013, IEEE Signal Process. Mag..

[27]  Anis Sakly,et al.  On Stability Analysis of Switched Linear Time-Delay Systems under Arbitrary Switching , 2015 .

[28]  Zhiwu Li,et al.  Formal Methods in Manufacturing Systems: Recent Advances , 2013 .

[29]  Jorge Luis García-Alcaraz,et al.  An Ergonomic Compatibility Perspective on the Selection of Advanced Manufacturing Technology: A Case Study for CNC Vertical Machining Centers , 2016 .

[30]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[31]  Yuriy V. Zakharov,et al.  Coordinate descent iterations in fast affine projection algorithm , 2005, IEEE Signal Processing Letters.

[32]  Cuauhtémoc Sánchez-Ramírez,et al.  Handbook of Research on Managerial Strategies for Achieving Optimal Performance in Industrial Processes , 2016 .

[33]  Yuriy V. Zakharov,et al.  Pseudo-Affine Projection Algorithms for Multichannel Active Noise Control , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[34]  Paul Honeine,et al.  Online Prediction of Time Series Data With Kernels , 2009, IEEE Trans. Signal Process..

[35]  Jie Yang,et al.  Efficient μ-law improved proportionate affine projection algorithm for echo cancellation , 2011 .

[36]  Dinu Coltuc,et al.  An efficient implementation of the kernel affine projection algorithm , 2013, 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA).

[37]  Jacob Benesty,et al.  A low complexity proportionate affine projection algorithm for echo cancellation , 2010, 2010 18th European Signal Processing Conference.

[38]  S. Salhi,et al.  On Proportional Plus Derivative State Feedback H2 Control for Descriptor Systems , 2015 .

[39]  Ligang Liu,et al.  A Variable Step-Size Proportionate Affine Projection Algorithm for Identification of Sparse Impulse Response , 2009, EURASIP J. Adv. Signal Process..

[40]  Raymond H. Kwong,et al.  A variable step size LMS algorithm , 1992, IEEE Trans. Signal Process..

[41]  T. Tozer,et al.  Multiplication-free iterative algorithm for LS problem , 2004 .

[42]  Weifeng Liu,et al.  Kernel Adaptive Filtering , 2010 .