Logarithmic Hyperbolic Cosine Adaptive Filter and Its Performance Analysis

The hyperbolic cosine function with high-order errors can be utilized to improve the accuracy of adaptive filters. However, when initial weight errors are large, the hyperbolic cosine-based adaptive filter (HCAF) may be unstable. In this paper, a novel normalization based on the logarithmic hyperbolic cosine function is proposed to achieve the stabilization for the case of large initial weight errors, which generates a logarithmic HCAF (LHCAF). Actually, the cost function of LHCAF is the logarithmic hyperbolic cosine function that is robust to large errors and smooth to small errors. The transient and steady-state analyses of LHCAF in terms of the mean-square deviation (MSD) are performed for a stationary white input with an even probability density function in a stationary zero-mean white noise. The convergence and stability of LHCAF can be therefore guaranteed as long as the filtering parameters satisfy certain conditions. The theoretical results based on the MSD are supported by the simulations. In addition, a variable scaling factor and step-size LHCAF (VSS-LHCAF) is proposed to improve the filtering accuracy of LHCAF further. The proposed LHCAF and VSS-LHCAF are superior to HCAF and other robust adaptive filters in terms of filtering accuracy and stability.

[1]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[2]  Eweda Eweda,et al.  Stochastic Analysis of a Stable Normalized Least Mean Fourth Algorithm for Adaptive Noise Canceling With a White Gaussian Reference , 2012, IEEE Transactions on Signal Processing.

[3]  Sheng Zhang,et al.  NLMS Algorithm Based on a Variable Parameter Cost Function Robust Against Impulsive Interferences , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[4]  Shing-Chow Chan,et al.  A recursive least M-estimate algorithm for robust adaptive filtering in impulsive noise: fast algorithm and convergence performance analysis , 2004, IEEE Transactions on Signal Processing.

[5]  A. Sayed,et al.  Steady-state and tracking analyses of the sign algorithm without the explicit use of the independence assumption , 2000, IEEE Signal Processing Letters.

[6]  Suleyman Serdar Kozat,et al.  A Novel Family of Adaptive Filtering Algorithms Based on the Logarithmic Cost , 2013, IEEE Transactions on Signal Processing.

[7]  Manish Narwaria,et al.  Lorentzian Based Adaptive Filters for Impulsive Noise Environments , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[9]  Nanning Zheng,et al.  Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering , 2016, IEEE Transactions on Signal Processing.

[10]  Jacob Benesty,et al.  An Affine Projection Sign Algorithm Robust Against Impulsive Interferences , 2010, IEEE Signal Processing Letters.

[11]  Jeen-Shing Wang,et al.  A digital circuit design of hyperbolic tangent sigmoid function for neural networks , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[12]  Eweda Eweda,et al.  Stabilization of High-Order Stochastic Gradient Adaptive Filtering Algorithms , 2017, IEEE Transactions on Signal Processing.

[13]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[14]  Ali H. Sayed,et al.  Robust Adaptation in Impulsive Noise , 2016, IEEE Transactions on Signal Processing.

[15]  Sheng Zhang,et al.  Robust Variable Step-Size Decorrelation Normalized Least-Mean-Square Algorithm and its Application to Acoustic Echo Cancellation , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[16]  Robert W. Newcomb,et al.  A Normalized Least Mean Squares Algorithm With a Step-Size Scaler Against Impulsive Measurement Noise , 2013, IEEE Transactions on Circuits and Systems II: Express Briefs.

[17]  J. Chambers,et al.  A robust mixed-norm adaptive filter algorithm , 1997, IEEE Signal Processing Letters.

[18]  Ji Zhao,et al.  Switching criterion for sub-and super-Gaussian additive noise in adaptive filtering , 2018, Signal Process..

[19]  Badong Chen,et al.  Common Spatial Patterns Based on the Quantized Minimum Error Entropy Criterion , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  José Carlos M. Bermudez,et al.  A Mean-Square Stability Analysis of the Least Mean Fourth Adaptive Algorithm , 2007, IEEE Transactions on Signal Processing.

[21]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[22]  Tareq Y. Al-Naffouri,et al.  Adaptive Filters with Error Nonlinearities: Mean-Square Analysis and Optimum Design , 2001, EURASIP J. Adv. Signal Process..

[23]  Badong Chen,et al.  Maximum Correntropy Estimation Is a Smoothed MAP Estimation , 2012, IEEE Signal Processing Letters.

[24]  C. K. Michael Tse,et al.  A class of improved least sum of exponentials algorithms , 2016, Signal Process..

[25]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[26]  Zhigang Liu,et al.  Robust Set-Membership Normalized Subband Adaptive Filtering Algorithms and Their Application to Acoustic Echo Cancellation , 2017, IEEE Transactions on Circuits and Systems I: Regular Papers.

[27]  Weifeng Liu,et al.  Kernel Adaptive Filtering: A Comprehensive Introduction , 2010 .

[28]  Yin Yang,et al.  Memristor-Based Echo State Network With Online Least Mean Square , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  Eweda Eweda,et al.  A Stable Normalized Least Mean Fourth Algorithm With Improved Transient and Tracking Behaviors , 2016, IEEE Transactions on Signal Processing.

[30]  Eweda Eweda,et al.  Mean-Square Stability Analysis of a Normalized Least Mean Fourth Algorithm for a Markov Plant , 2014, IEEE Transactions on Signal Processing.

[31]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[32]  Binwei Weng,et al.  Nonlinear system identification in impulsive environments , 2005, IEEE Transactions on Signal Processing.

[33]  Ju H. Park,et al.  New Methods of Fuzzy Sampled-Data Control for Stabilization of Chaotic Systems , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[34]  José Carlos M. Bermudez,et al.  Probability of divergence for the least-mean fourth algorithm , 2006, IEEE Transactions on Signal Processing.

[35]  Gang Wang,et al.  A Framework of Target Detection in Hyperspectral Imagery Based on Blind Source Extraction , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Paul Petrus,et al.  Robust Huber adaptive filter , 1999, IEEE Trans. Signal Process..

[37]  Yi Yu,et al.  A new normalized LMAT algorithm and its performance analysis , 2014, Signal Process..

[38]  Peng Shi,et al.  Robust Kalman Filters Based on Gaussian Scale Mixture Distributions With Application to Target Tracking , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.