The outlier-corrected-data-adaptive Lasso: A new robust estimator for the independent contamination model

Many of today's signal processing tasks consider sparse models where the number of explanatory variables exceeds the sample size. When dealing with real-world data, the presence of impulsive noise and outliers must also be accounted for. Accurate and robust parameter estimation and consistent variable selection are needed simultaneously. Recently, some popular robust methods have been adapted to such complex settings. Especially, in high dimensional settings, however, it is possible to have a single contaminated predictor being responsible for many outliers. The amount of outliers introduced by this predictor easily exceeds the breakdown point of any existing robust estimator. Therefore, we propose a new robust and sparse estimator, the Outlier-Corrected-Data-(Adaptive) Lasso (OCD-(A) Lasso). It simultaneously handles highly contaminated predictors in the dataset and performs well under the classical contamination model. In a numerical study, it outperforms competing Lasso estimators, at a largely reduced computational complexity compared to its robust counterparts.

[1]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[2]  H. Zou The Adaptive Lasso and Its Oracle Properties , 2006 .

[3]  Yacine Chitour,et al.  Generalized Robust Shrinkage Estimator and Its Application to STAP Detection Problem , 2013, IEEE Transactions on Signal Processing.

[4]  Martin Vetterli,et al.  A robust method for inverse transport modeling of atmospheric emissions using blind outlier detection , 2014 .

[5]  Michael Muma,et al.  A new robust and efficient estimator for ill-conditioned linear inverse problems with outliers , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Esa Ollila Adaptive LASSO based on joint M-estimation of regression and scale , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[7]  Michael Muma,et al.  Robust Estimation in Signal Processing: A Tutorial-Style Treatment of Fundamental Concepts , 2012, IEEE Signal Processing Magazine.

[8]  Victor J. Yohai,et al.  Robust and sparse estimators for linear regression models , 2015, Comput. Stat. Data Anal..

[9]  Peter Rousseeuw,et al.  Detecting Deviating Data Cells , 2016, Technometrics.

[10]  G. Willems,et al.  Stahel-Donoho estimators with cellwise weights , 2011 .

[11]  Stefan Van Aelst,et al.  Propagation of outliers in multivariate data , 2009, 0903.0447.

[12]  Xue Jiang,et al.  Outlier-Robust Greedy Pursuit Algorithms in $\ell _{p}$ -Space for Sparse Approximation , 2016, IEEE Transactions on Signal Processing.

[13]  Romain Couillet,et al.  Robust Estimates of Covariance Matrices in the Large Dimensional Regime , 2012, IEEE Transactions on Information Theory.

[14]  Christophe Croux,et al.  The shooting S-estimator for robust regression , 2015, Comput. Stat..

[15]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .