New Robust Estimators of Correlation and Weighted Basis Pursuit

The autocorrelation function is a commonly used tool in statistical time series analysis. In this paper we examine the robustness of two estimators of correlation based on memoryless nonlinear functions of the observations, the Median-of-Ratios Estimator (MRE) and the Phase-Phase Correlator (PPC), which are applicable to complex-valued Gaussian random processes. We show that they are robust to impulsive noise from a bias perspective at the expense of statistical efficiency at the Gaussian distribution. Additionally, we develop iterative versions of these estimators named the IMRE and IPPC, realizing an improved bias performance over their non-iterative counterparts and the well-known robust Schweppe-type Generalized M-estimator utilizing a Huber cost function (SHGM). We use robust Mahalanobis distances generated by the IMRE and IPPC to improve the performance of impulsive noise suppression through the use of weighted basis pursuit methods. These estimation and data-cleaning techniques are applied to both synthetic and actual collected data using an Ettus Research USRP to perform robust spectral estimation on signals from the digital television band in the presence of additive impulsive noise. Finally, the analysis reveals that if the time series is highly correlated and the contamination rate is low, the MRE outperforms the PPC estimator from a variance and bias perspective. However, the PPC is the estimator of choice when the correlation is lower and is better suited to time critical applications due to lower computation costs.

[1]  Pascal Bondon,et al.  Robust estimation of SARIMA models: Application to short-term load forecasting , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[2]  Irving S. Reed,et al.  On the use of Laguerre polynomials in treating the envelope and phase components of narrow-band Gaussian noise , 1959, IRE Trans. Inf. Theory.

[3]  Lamine Mili,et al.  Robust Mahalanobis distances in power system state estimation , 1993, Proceedings of 36th Midwest Symposium on Circuits and Systems.

[4]  D. Thomson,et al.  Spectrum estimation and harmonic analysis , 1982, Proceedings of the IEEE.

[5]  Weifang Wang,et al.  Spectrum sensing in cognitive radio , 2016 .

[6]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[7]  V. Yohai,et al.  Robust Statistics: Theory and Methods , 2006 .

[8]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[9]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[10]  Lamine Mili,et al.  A Robust GM-Estimator for the Automated Detection of External Defects on Barked Hardwood Logs and Stems , 2007, IEEE Transactions on Signal Processing.

[11]  L. Mili,et al.  Improved detection of strong nonhomogeneities for STAP via projection statistics , 2005, IEEE International Radar Conference, 2005..

[12]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[13]  Pierre Vandergheynst,et al.  On the use of a priori information for sparse signal approximations , 2006, IEEE Transactions on Signal Processing.

[14]  Zhen Yang,et al.  Bayesian Sparse Reconstruction Method of Compressed Sensing in the Presence of Impulsive Noise , 2013, Circuits, Systems, and Signal Processing.

[15]  F. Y. Edgeworth XXII. On a new method of reducing observations relating to several quantities , 1888 .

[16]  Lamine Mili,et al.  Robustness Analysis of the Phase-Phase Correlator to White Impulsive Noise With Applications to Autoregressive Modeling , 2012, IEEE Transactions on Signal Processing.

[17]  Xiaoming Huo,et al.  Uncertainty principles and ideal atomic decomposition , 2001, IEEE Trans. Inf. Theory.

[18]  S. Vaseghi Detection and suppression of impulsive noise in speech communication systems , 1990 .

[19]  M. Sánchez,et al.  Impulsive noise measurements and characterization in a UHF digital TV channel , 1999 .

[20]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[21]  Alessandro Neri,et al.  Estimation of the autocorrelation function of complex Gaussian stationary processes by amplitude clipped signals , 1994, IEEE Trans. Inf. Theory.

[22]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[23]  N. R. Goodman Statistical analysis based on a certain multivariate complex Gaussian distribution , 1963 .

[24]  Lamine Mili,et al.  Robust Kalman Filter Based on a Generalized Maximum-Likelihood-Type Estimator , 2010, IEEE Transactions on Signal Processing.

[25]  Yacine Chakhchoukh,et al.  A New Robust Estimation Method for ARMA Models , 2009, IEEE Transactions on Signal Processing.

[26]  V. Yohai,et al.  Projection estimates of multivariate location , 2002 .

[27]  Robert J. Baxley,et al.  Complex Gaussian Ratio Distribution with Applications for Error Rate Calculation in Fading Channels with Imperfect CSI , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[28]  Eric W. Weisstein,et al.  CRC encyclopedia of mathematics , 2009 .

[29]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .