Performance of Some Logistic Ridge Regression Estimators

In this paper we generalize different approaches of estimating the ridge parameter k proposed by Muniz et al. (Comput Stat, 2011) to be applicable for logistic ridge regression (LRR). These new methods of estimating the ridge parameter in LRR are evaluated by means of Monte Carlo simulations along with the some other estimators of k that has already been evaluated by Månsson and Shukur (Commun Stat Theory Methods, 2010) together with the traditional maximum likelihood (ML) approach. As a performance criterion we use the mean squared error (MSE). In the simulation study we also calculate the mean value and the standard deviation of k. The average value is interesting firstly in order to see what values of k that are reasonable and secondly if several estimators have equal variance then the estimator that induces the smallest bias should be chosen. The standard deviation is interesting as a performance criteria if several estimators of k have the same MSE, then the most stable estimator (with the lowest standard deviation) should be chosen. The result from the simulation study shows that LRR outperforms ML approach. Furthermore, some of new proposed ridge estimators outperformed those proposed by Månsson and Shukur (Commun Stat Theory Methods, 2010).

[1]  R. Schaefer Alternative estimators in logistic regression when the data are collinear , 1986 .

[2]  G. C. McDonald,et al.  A Monte Carlo Evaluation of Some Ridge-Type Estimators , 1975 .

[3]  A. E. Hoerl,et al.  Ridge regression:some simulations , 1975 .

[4]  G. Shukur,et al.  On Ridge Parameters in Logistic Regression , 2011 .

[5]  B. M. Kibria,et al.  Performance of Some New Ridge Regression Estimators , 2003 .

[6]  J. Lawless,et al.  A simulation study of ridge and other regression estimators , 1976 .

[7]  N. Wermuth,et al.  A Simulation Study of Alternatives to Ordinary Least Squares , 1977 .

[8]  A. E. Hoerl,et al.  Ridge Regression: Applications to Nonorthogonal Problems , 1970 .

[9]  D. Gibbons A Simulation Study of Some Ridge Estimators , 1981 .

[10]  Ghazi Shukur,et al.  Some Modifications for Choosing Ridge Parameters , 2006 .

[11]  W. B. Smith An Appreciation of Anant M. Kshirsagar , 2006 .

[12]  G. Shukur,et al.  Developing Ridge Parameters for SUR Model , 2008 .

[13]  Comment on hoerl and kennard's ridge regression simulation methodology , 1981 .

[14]  B. M. Golam Kibria,et al.  A Simulation Study of Some Ridge Regression Estimators under Different Distributional Assumptions , 2010, Commun. Stat. Simul. Comput..

[15]  B. M. Golam Kibria,et al.  Please Scroll down for Article Communications in Statistics -simulation and Computation on Some Ridge Regression Estimators: an Empirical Comparisons on Some Ridge Regression Estimators: an Empirical Comparisons , 2022 .

[16]  Kristofer Månsson,et al.  On Developing Ridge Regression Parameters: A Graphical investigation , 2012 .

[17]  R. Frisch Statistical confluence analysis by means of complete regression systems , 1934 .

[18]  G. Khalaf,et al.  Choosing Ridge Parameter for Regression Problems , 2005 .

[19]  Joseph P. Newhouse,et al.  An Evaluation of Ridge Estimators , 1971 .

[20]  R. Schaefer,et al.  A ridge logistic estimator , 1984 .