Generalized Additive Models

Likelihood-based regression models such as the normal linear regression model and the linear logistic model, assume a linear (or some other parametric) form for the covariates X1, X2, *--, Xp. We introduce the class of generalized additive models which replaces the linear form E fjXj by a sum of smooth functions E sj(Xj). The sj(.)'s are unspecified functions that are estimated using a scatterplot smoother, in an iterative procedure we call the local scoring algorithm. The technique is applicable to any likelihood-based regression model: the class of generalized linear models contains many of these. In this class the linear predictor q = E fjXj is replaced by the additive predictor E sj(Xj); hence, the name generalized additive models. We illustrate the technique with binary response and survival data. In both cases, the method proves to be useful in uncovering nonlinear covariate effects. It has the advantage of being completely auto- matic, i.e., no "detective work" is needed on the part of the statistician. As a theoretical underpinning, the technique is viewed as an empirical method of maximizing the expected log likelihood, or equivalently, of minimizing the Kullback-Leibler distance to the true model.

[1]  R. Tibshirani,et al.  Generalized Additive Models: Some Applications , 1987 .

[2]  C. J. Stone,et al.  The Dimensionality Reduction Principle for Generalized Additive Models , 1986 .

[3]  B. Yandell,et al.  Automatic Smoothing of Regression Functions in Generalized Linear Models , 1986 .

[4]  J. Friedman,et al.  Estimating Optimal Transformations for Multiple Regression and Correlation. , 1985 .

[5]  B. Yandell,et al.  Semi-Parametric Generalized Linear Models. , 1985 .

[6]  T. Hastie.  Principal Curves and Surfaces , 1984 .

[7]  R. Tibshirani,et al.  The Monotone Smoothing of Scatterplots , 1984 .

[8]  D. Pregibon,et al.  Graphical Methods for Assessing Logistic Regression Models: Rejoinder , 1984 .

[9]  D. Pregibon,et al.  Graphical Methods for Assessing Logistic Regression Models , 1984 .

[10]  Rupert G. Miller,et al.  Regression with censored data , 1982 .

[11]  Jerome H. Friedman,et al.  Smoothing of Scatterplots , 1982 .

[12]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[13]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[14]  Forrest W. Young,et al.  The principal components of mixed measurement level multivariate data: An alternating least squares method with optimal scaling features , 1978 .

[15]  H. D. Brunk,et al.  Discussion: Consistent Nonparametric Regression , 1977 .

[16]  J. Crowley,et al.  Covariance Analysis of Heart Transplant Survival Data , 1977 .

[17]  D. Cox,et al.  The analysis of binary data , 1971 .

[18]  C. Reinsch.  Smoothing by spline functions , 1967 .

[19]  A. Owen.  THE ESTIMATION OF SMOOTH CURVES* , 1984 .

[20]  P. McCullagh.  Regression Models for Ordinal Data , 1980 .

[21]  G. Wahba,et al.  A completely automatic french curve: fitting spline functions by cross validation , 1975 .

[22]  D. Cox.  Regression Models and Life-Tables , 1972 .

[23]  C. J. Stone,et al.  Hazard Regression , 2022 .