Shrinkage Ridge Estimators in Linear Regression

The problem of estimation of the regression coefficients in a multiple regression model (MRM) is considered under multicollinearity situation. Further it is suspected that the regression coefficients may be restricted to a subspace. In this approach, we present the estimators of the regression coefficients combining the idea of preliminary test estimator and Stein-rule estimator with the ridge regression methodology for elliptically contoured distributions (ECD). Accordingly, their exact risk expressions in addition to biases are derived. The estimators under study are compared and the regions of optimality of the estimators are exactly determined along with some numerical analysis. In this regard, the ridge parameter is determined in different disciplines.

[1]  A. K. Md. Ehsanes Saleh,et al.  Estimation of parameters of parallelism model with elliptically distributed errors , 2010 .

[2]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[3]  K. Fang,et al.  Generalized Multivariate Analysis , 1990 .

[4]  K. Chu Estimation and decision for linear systems with elliptical random processes , 1972, CDC 1972.

[5]  B. M. Golam Kibria,et al.  On some ridge regression estimators: a nonparametric approach , 2011 .

[6]  A. K. Md. Ehsanes Saleh,et al.  Performance of some new preliminary test ridge regression estimators and their properties , 1993 .

[7]  S. Kotz,et al.  Symmetric Multivariate and Related Distributions , 1989 .

[8]  D. Gibbons A Simulation Study of Some Ridge Estimators , 1981 .

[9]  Shahjahan Khan,et al.  Estimation in multiple regression model with elliptically contoured errors under MLINEX loss , 2008 .

[10]  A. K. Md. Ehsanes Saleh,et al.  Theory of preliminary test and Stein-type estimation with applications , 2006 .

[11]  G. C. McDonald,et al.  A Monte Carlo Evaluation of Some Ridge-Type Estimators , 1975 .

[12]  B. M. Kibria Performance of the shrinkage preliminary test ridge regression estimators based on the conflicting of W, LR and LM tests , 2004 .

[13]  A. K. Md. Ehsanes Saleh,et al.  Optimum Critical Value for Pre-Test Estimator , 2006 .

[14]  A. K. Md. Ehsanes Saleh,et al.  Preliminary test ridge regression estimators with student’s t errors and conflicting test-statistics , 2004 .

[15]  B. M. Kibria,et al.  Estimation of the Mean Vector of a Multivariate Elliptically Contoured Distribution , 2010 .

[16]  Rand R. Wilcox,et al.  The statistical implications of pre-test and Stein-rule estimators in econometrics , 1978 .