An Additional Measure of Overall Effect Size for Logistic Regression Models

Users of logistic regression models often need to describe the overall predictive strength, or effect size, of the model’s predictors. Analogs of R 2 have been developed, but none of these measures are interpretable on the same scale as effects of individual predictors. Furthermore, R 2 analogs are not invariant to the base rate (overall proportion of successes), making it difficult to compare effect sizes across data sets. The authors propose a measure of overall effect size that is interpretable on the same scale as effects of individual predictors and is invariant to the base rate. They explore the properties of the overall odds ratio and illustrate its use through an example. They also provide interpretive guidance and illustrate how statistical software can be used to compute the proposed measure.

[1]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[2]  P. McCullagh,et al.  Bias Correction in Generalized Linear Models , 1991 .

[3]  B. Efron.  The jackknife, the bootstrap, and other resampling plans , 1987 .

[4]  A jackknife maximum likelihood estimator for the probit model , 2002 .

[5]  D. McFadden.  MEASUREMENT OF URBAN TRAVEL DEMAND , 1974 .

[6]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[7]  R. Wherry,et al.  A New Formula for Predicting the Shrinkage of the Coefficient of Multiple Correlation , 1931 .

[8]  N. Nagelkerke,et al.  A note on a general definition of the coefficient of determination , 1991 .

[9]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[10]  N. Draper,et al.  Applied Regression Analysis , 1967 .

[11]  David R. Cox.  The analysis of binary data , 1970 .

[12]  John H. Aldrich,et al.  Linear probability, logit and probit models , 1984 .

[13]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[14]  J. Liao,et al.  Adjusted Coefficients of Determination for Logistic Regression , 2003 .

[15]  James A. Rosenthal,et al.  Qualitative Descriptors of Strength of Association and Effect Size , 1996 .

[16]  N. Draper,et al.  Applied Regression Analysis: Draper/Applied Regression Analysis , 1998 .

[17]  Jeff M. Allen,et al.  Unraveling the Differential Effects of Motivational and Skills, Social, and Self-Management Measures from Traditional Predictors of College Outcomes. , 2006 .

[18]  S. Menard.  Applied Logistic Regression Analysis , 1996 .

[19]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[20]  C. Y. Peng,et al.  An Introduction to Logistic Regression Analysis and Reporting , 2002 .

[21]  A. Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[22]  S. Menard.  Coefficients of Determination for Multiple Logistic Regression Analysis , 2000 .