Generalized linear regression on sampled signals and curves: a P -spline approach

We consider generalized linear regression with many highly correlated regressors—for instance, digitized points of a curve on a spatial or temporal domain. We refer to this setting as signal regression, which requires severe regularization because the number of regressors is large, often exceeding the number of observations. We solve collinearity by forcing the coefficient vector to be smooth on the same domain. Dimension reduction is achieved by projecting the signal coefficient vector onto a moderate number of B splines. A difference penalty between the B-spline coefficients further increases smoothness-the P-spline framework of Eilers and Marx. The procedure is regulated by a penalty parameter chosen using information criteria or cross-validation.

[1]  B. Marx,et al.  Principal component estimation for generalized linear regression , 1990 .

[2]  I. Helland ON THE STRUCTURE OF PARTIAL LEAST SQUARES REGRESSION , 1988 .

[3]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[4]  M. Stone Continuum regression: Cross-validated sequentially constructed prediction embracing ordinary least s , 1990 .

[5]  P. J. Brown,et al.  Calibration with Many Variables , 1993 .

[6]  Tom Fearn,et al.  Partial Least Squares Regression on Smooth Factors , 1996 .

[7]  T. Fearn,et al.  Application of near infrared reflectance spectroscopy to the compositional analysis of biscuits and biscuit doughs , 1984 .

[8]  Paul Dierckx,et al.  Curve and surface fitting with splines , 1994, Monographs on numerical analysis.

[9]  R. Tibshirani,et al.  Penalized Discriminant Analysis , 1995 .

[10]  B. Marx Iteratively reweighted partial least squares estimation for generalized linear regression , 1996 .

[11]  B. K. Alsberg Representation of spectra by continuous functions , 1993 .

[12]  J. Friedman,et al.  FLEXIBLE PARSIMONIOUS SMOOTHING AND ADDITIVE MODELING , 1989 .

[13]  Paul H. C. Eilers,et al.  Flexible smoothing with B-splines and penalties , 1996 .

[14]  Paul H. C. Eilers,et al.  Direct generalized additive modeling with penalized likelihood , 1998 .

[15]  T. Hastie,et al.  [A Statistical View of Some Chemometrics Regression Tools]: Discussion , 1993 .

[16]  C. Reinsch Smoothing by spline functions , 1967 .

[17]  John A. Nelder,et al.  Generalized linear models. 2nd ed. , 1993 .

[18]  田中 豊 Multivariate Statistical Modelling Based on Generalized Linear Models/Ludwig Fahrmeir,Gerhard Tutz(1994) , 1995 .

[19]  S. Cessie,et al.  Ridge Estimators in Logistic Regression , 1992 .

[20]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[21]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[22]  Finbarr O'Sullivan,et al.  [A Statistical Perspective on Ill-Posed Inverse Problems]: Rejoinder , 1986 .

[23]  J. Q. Smith,et al.  1. Bayesian Statistics 4 , 1993 .

[24]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[25]  J. Friedman,et al.  A Statistical View of Some Chemometrics Regression Tools , 1993 .

[26]  R. H. Myers Classical and modern regression with applications , 1986 .

[27]  Annette J. Dobson,et al.  An introduction to generalized linear models , 1991 .