State space least p-power filter

Abstract As a new addition to the recursive least squares (RLS) family filters, the state space recursive least squares (SSRLS) filter can achieve desirable performance by conquering some limitations of the standard RLS filter. However, when the system is contaminated by some non-Gaussian noises, the performance of SSRLS will get worse. The main reason for this is that the SSRLS is developed under the well-known minimum mean square error (MMSE) criterion, which is not very suitable for non-Gaussian situations. To address this issue, in this paper, we propose a new state space based linear filter, called the state space least p -power (SSLP) filter, which is derived under the least mean p -power error (LMP) criterion instead of the MMSE. With a proper p value, the SSLP can outperform the SSRLS substantially especially in non-Gaussian noises. Two illustrative examples are presented to show the satisfactory results of the new algorithm.

[1]  C. Sidney Burrus,et al.  L/sub p/-complex approximation using iterative reweighted least squares for FIR digital filters , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Mohammad Bilal Malik,et al.  Tracking of linear time varying systems by state-space recursive least-squares , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[3]  Binwei Weng,et al.  Nonlinear system identification in impulsive environments , 2005, IEEE Transactions on Signal Processing.

[4]  信太 克規,et al.  Adaptive Algorithm Based on Least Mean p-Power Error Criterion for Fourier Analysis in Additive Noise , 1998 .

[5]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[6]  Wang Jun,et al.  Estimating the frequency in power system based on state space recursive least squares , 2008, 2008 3rd IEEE Conference on Industrial Electronics and Applications.

[7]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[8]  Mohammad Bilal Malik,et al.  State-space recursive least squares: Part II , 2004, Signal Process..

[9]  Y. Cho,et al.  Fixed Point Theory and Applications , 2000 .

[10]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[11]  Nanning Zheng,et al.  Convergence of a Fixed-Point Algorithm under Maximum Correntropy Criterion , 2015, IEEE Signal Processing Letters.

[12]  Zengqi Sun,et al.  Stochastic Gradient Algorithm Under (h,φ)-Entropy Criterion , 2007 .

[13]  J. Mohammed,et al.  An Efficient RLS Algorithm For Output-Error Adaptive IIR Filtering And Its Application To Acoustic Echo Cancellation , 2007, 2007 IEEE Symposium on Computational Intelligence in Image and Signal Processing.

[14]  S. Kahng,et al.  Best L4 Approximation , 1972 .

[15]  C. Sidney Burrus,et al.  Iterative reweighted least-squares design of FIR filters , 1994, IEEE Trans. Signal Process..

[16]  M.B. Malik,et al.  State-space recursive least-squares based object tracking , 2004, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[17]  Weifeng Liu,et al.  Kernel Adaptive Filtering: A Comprehensive Introduction , 2010 .

[18]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[19]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[20]  M.B. Malik,et al.  On spectrum estimation using state space recursive least squares (SSRLS) , 2004, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[21]  W. Rugh.  Linear System Theory , 1992 .

[22]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[23]  Ali H. Sayed,et al.  Linear Estimation (Information and System Sciences Series) , 2000 .

[24]  Razali Jidin,et al.  Performance study of adaptive filtering algorithms for noise cancellation of ECG signal , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[25]  Jinchun Hu,et al.  ADAPTIVE FILTERING WITH ADAPTIVE p-POWER ERROR CRITERION , 2011 .

[26]  S. W. Kahng.  Best _{} approximation , 1972 .

[27]  Deniz Erdogmus,et al.  An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems , 2002, IEEE Trans. Signal Process..

[28]  Mohammad Bilal Malik,et al.  State-space RLS , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[29]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[30]  Badong Chen,et al.  Maximum Correntropy Estimation Is a Smoothed MAP Estimation , 2012, IEEE Signal Processing Letters.

[31]  Chien-Cheng Tseng,et al.  Least mean p-power error criterion for adaptive FIR filter , 1994, IEEE J. Sel. Areas Commun..

[32]  R. Fletcher,et al.  The Calculation of Linear Best L_p Approximations , 1971, Comput. J..

[33]  L. Dixon,et al.  Finite Algorithms in Optimization and Data Analysis. , 1988 .

[34]  Ling Wang,et al.  Improved RLS positioning algorithm for satellite navigation systems , 2012, 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2012).

[35]  Chien-Cheng Tseng,et al.  Design of stable IIR digital filter based on least P-power error criterion , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[36]  Xi Liu,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < , 2022 .

[37]  C. S. Burrus,et al.  Least p-power error design of FIR filters , 1992, [Proceedings] 1992 IEEE International Symposium on Circuits and Systems.

[38]  Nanning Zheng,et al.  Smoothed least mean p-power error criterion for adaptive filtering , 2015, Digit. Signal Process..

[39]  Badong Chen,et al.  Mean-Square Convergence Analysis of ADALINE Training With Minimum Error Entropy Criterion , 2010, IEEE Transactions on Neural Networks.

[40]  G. Geng,et al.  Application of a neural-network-based RLS algorithm in the generalized predictive control of a nonlinear air-handling plant , 1997, IEEE Trans. Control. Syst. Technol..

[41]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[42]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[43]  Wang Ling,et al.  Improved RLS positioning algorithm for satellite navigation systems , 2012 .

[44]  Antonio J. Serrano,et al.  Non-linear RLS-based algorithm for pattern classification , 2006, Signal Process..

[45]  Badong Chen,et al.  System Parameter Identification: Information Criteria and Algorithms , 2013 .

[46]  L. Karlovitz,et al.  Construction of nearest points in the Lp, p even, and L∞ norms. I , 1970 .

[47]  Benoît Champagne,et al.  A low-complexity variable forgetting factor constant modulus RLS algorithm for blind adaptive beamforming , 2014, Signal Process..

[48]  W. Steiger,et al.  Least Absolute Deviations: Theory, Applications and Algorithms , 1984 .