Entropy coefficient of determination for generalized linear models

The objective of the present paper is to propose a predictive power measure for generalized linear models (GLMs). First, basic predictive power measures for GLMs are compared with respect to some desirable properties. We propose a generalized coefficient of determination for GLMs, which is referred to as the entropy coefficient of determination (ECD). The advantage of the measure is discussed in the GLM framework. Second, the asymptotic properties of the maximum likelihood estimator of ECD are discussed. Third, ECD is applied to GLMs with polytomous response variables. Finally, discussions and a conclusion to this study are provided.

[1]  J. Kent.  Information gain and a general measure of correlation , 1983 .

[2]  H. Theil.  On the Estimation of Relationships Involving Qualitative Variables , 1970, American Journal of Sociology.

[3]  B. Efron.  Regression and ANOVA with Zero-One Data: Measures of Residual Variation , 1978 .

[4]  Nobuoki Eshima,et al.  Entropy correlation coefficient for measuring predictive power of generalized linear models , 2007 .

[5]  A. Ash,et al.  R2: a useful measure of model performance when predicting a dichotomous outcome. , 1999, Statistics in medicine.

[6]  S. Haberman.  Analysis of Dispersion of Multinomial Responses , 1982 .

[7]  A. Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[8]  Alan Agresti.  Applying R 2 -Type measures to ordered categorical data , 1986 .

[9]  M Schemper,et al.  Explained variation for logistic regression. , 1996, Statistics in medicine.

[10]  R. Cook.  Generalized Linear Model , 2005 .

[11]  Richard Simon,et al.  Explained Residual Variation, Explained Risk, and Goodness of Fit , 1991 .

[12]  L. A. Goodman.  The Analysis of Multidimensional Contingency Tables: Stepwise Procedures and Direct Estimation Methods for Building Models for Multiple Classifications , 1971 .

[13]  A Agresti,et al.  Summarizing the predictive power of a generalized linear model. , 2000, Statistics in medicine.

[14]  J. Chimka.  Categorical Data Analysis, Second Edition , 2003 .

[15]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[16]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.