A heuristic approach to combat multicollinearity in least trimmed squares regression analysis

Abstract In order to down-weight or ignore unusual data and multicollinearity effects, some alternative robust estimators are introduced. Firstly, a ridge least trimmed squares approach is discussed. Then, based on a penalization scheme, a nonlinear integer programming problem is suggested. Because of complexity and difficulty, the proposed optimization problem is solved by a tabu search heuristic algorithm. Also, the robust generalized cross validation criterion is employed for selecting the optimal ridge parameter. Finally, a simulation case and two real-world data sets are computationally studied to support our theoretical discussions.

[1]  Mahdi Roozbeh,et al.  Robust ridge estimator in restricted semiparametric regression models , 2016, J. Multivar. Anal..

[2]  Lu Chen,et al.  A tabu search algorithm for the relocation problem in a warehousing system , 2011 .

[3]  S. Babaie-Kafaki,et al.  Extended least trimmed squares estimator in semiparametric regression models with correlated errors , 2016 .

[4]  Morteza Amini,et al.  Optimal partial ridge estimation in restricted semiparametric regression models , 2015, J. Multivar. Anal..

[5]  Jin-Kao Hao,et al.  Adaptive Tabu Search for course timetabling , 2010, Eur. J. Oper. Res..

[6]  Masao Fukushima,et al.  Tabu Search directed by direct search methods for nonlinear global optimization , 2006, Eur. J. Oper. Res..

[7]  A. V. Dorugade.  Adjusted ridge estimator and comparison with Kibria’s method in linear regression , 2016 .

[8]  Selahattin Kaçıranlar,et al.  COMBINING THE LIU ESTIMATOR AND THE PRINCIPAL COMPONENT REGRESSION ESTIMATOR , 2001 .

[9]  Reza Ghanbari,et al.  Hybridizations of genetic algorithms and neighborhood search metaheuristics for fuzzy bus terminal location problems , 2016, Appl. Soft Comput..

[10]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[11]  Michael R. Baye,et al.  Combining ridge and principal component regression:a money demand illustration , 1984 .

[12]  D. Gibbons.  A Simulation Study of Some Ridge Estimators , 1981 .

[13]  S. Babaie-Kafaki,et al.  A class of biased estimators based on QR decomposition , 2016 .

[14]  G. C. McDonald,et al.  A Monte Carlo Evaluation of Some Ridge-Type Estimators , 1975 .

[15]  Tri-Dung Nguyen,et al.  Outlier detection and least trimmed squares approximation using semi-definite programming , 2010, Comput. Stat. Data Anal..

[16]  Liu Kejian,et al.  A new class of blased estimate in linear regression , 1993 .

[17]  Wolfgang K. Härdle,et al.  Difference Based Ridge and Liu Type Estimators in Semiparametric Regression Models , 2011, J. Multivar. Anal..