Robust Linearized Ridge M-estimator for Linear Regression Model

In the multiple linear regression, multicollinearity and outliers are commonly occurring problems. They produce undesirable effects on the ordinary least squares estimator. Many alternative parameter estimation methods are available in the literature which deals with these problems independently. In practice, it may happen that the multicollinearity and outliers occur simultaneously. In this article, we present a new estimator called as Linearized Ridge M-estimator which combats the problem of simultaneous occurrence of multicollinearity and outliers. A real data example and a simulation study is carried out to illustrate the performance of the proposed estimator.

[1]  P. J. Huber.  Robust Estimation of a Location Parameter , 1964 .

[2]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[3]  F. Gao,et al.  Linearized Ridge Regression Estimator Under the Mean Squared Error Criterion in a Linear Regression Model , 2011, Commun. Stat. Simul. Comput..

[4]  G. C. McDonald,et al.  A Monte Carlo Evaluation of Some Ridge-Type Estimators , 1975 .

[5]  Hamza Erol,et al.  Mean Squared Error Matrix Comparisons of Some Biased Estimators in Linear Regression , 2003 .

[6]  V. Yohai,et al.  Robust Statistics: Theory and Methods , 2006 .

[7]  M. I. Alheety,et al.  ON THE LIU AND ALMOST UNBIASED LIU ESTIMATORS IN THE PRESENCE OF MULTICOLLINEARITY WITH HETEROSCEDASTIC OR CORRELATED ERRORS , 2009 .

[8]  R. H. Myers.  Classical and modern regression with applications , 1986 .

[9]  R. R. Hocking,et al.  A Class of Biased Estimators in Linear Regression , 1976 .

[10]  Liu Kejian,et al.  A new class of blased estimate in linear regression , 1993 .

[11]  Ayşen Akkaya,et al.  Robust Estimation and Hypothesis Testing , 2004 .

[12]  Jammalamadaka.  Introduction to Linear Regression Analysis (3rd ed.) , 2003 .

[13]  Rui Portocarrero Sarmento,et al.  Introduction to Linear Regression , 2017 .

[14]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[15]  R. Obenchain.  Ridge Analysis Following a Preliminary Test of the Shrunken Hypothesis , 1975 .

[16]  Nedret Billor,et al.  Robust Liu estimator for regression based on an M-estimator , 2000 .

[17]  Mervyn J. Silvapulle,et al.  ROBUST RIDGE REGRESSION BASED ON AN M-ESTIMATOR , 1991 .

[18]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .

[19]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[20]  F. Gao,et al.  Linearized Ridge Regression Estimator in Linear Regression , 2011 .

[21]  Joyce Snell,et al.  6. Alternative Methods of Regression , 1996 .

[22]  Steffen Beich.  Alternative Methods Of Regression , 2016 .

[23]  A. E. Hoerl,et al.  Ridge Regression: Applications to Nonorthogonal Problems , 1970 .

[24]  Kuldeep Kumar,et al.  Robust Statistics, 2nd edn , 2011 .

[25]  Ji Fu,et al.  A New Class of Biased Estimate , 2013 .

[26]  Selahattin Kaçıranlar,et al.  A new biased estimator based on ridge estimation , 2008 .

[27]  Fikri Akdeniz,et al.  On the almost unbiased generalized liu estimator and unbiased estimation of the bias and mse , 1995 .

[28]  C. Jennison,et al.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[29]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[30]  David Birkes,et al.  Alternative Methods of Regression: Birkes/Alternative , 1993 .

[31]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[32]  J. Brian Gray,et al.  Introduction to Linear Regression Analysis , 2002, Technometrics.

[33]  D. N. Kashid,et al.  A Jackknifed Ridge M-estimator for Regression Model with Multicollinearity and Outliers , 2011 .