Multidimensional Penalized Signal Regression

We propose a general approach to regression on digitized multidimensional signals that can pose severe challenges to standard statistical methods. The main contribution of this work is to build a two-dimensional coefficient surface that allows for interaction across the indexing plane of the regressor array. We aim to use the estimated coefficient surface for reliable (scalar) prediction. We assume that the coefficients are smooth along both indices. We present a rather straightforward and rich extension of penalized signal regression using penalized B-spline tensor products, where appropriate difference penalties are placed on the rows and columns of the tensor product coefficients. Our methods are grounded in standard penalized regression, and thus cross-validation, effective dimension, and other diagnostics are accessible. Further, the model is easily transplanted into the generalized linear model framework. An illustrative example motivates our proposed methodology, and performance comparisons are made to other popular methods.

[1]  J. H. Schuenemeyer,et al.  Generalized Linear Models (2nd ed.) , 1992 .

[2]  R. H. Myers Classical and modern regression with applications , 1986 .

[3]  Paul Dierckx,et al.  Curve and surface fitting with splines , 1994, Monographs on numerical analysis.

[4]  Paul H. C. Eilers,et al.  Flexible smoothing with B-splines and penalties , 1996 .

[5]  Brian D Marx,et al.  Generalized Linear Additive Smooth Structures , 2002 .

[6]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[7]  B. Marx,et al.  Multivariate calibration with temperature interaction using two-dimensional penalized signal regression , 2003 .

[8]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[9]  Rasmus Bro,et al.  Orthogonal signal correction, wavelet analysis, and multivariate calibration of complicated process fluorescence data , 2000 .

[10]  Brian D. Marx,et al.  Generalized Linear Regression on Sampled Signals and Curves: A P-Spline Approach , 1999, Technometrics.

[11]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[12]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[13]  Paul H. C. Eilers,et al.  Fast and compact smoothing on large multidimensional grids , 2006, Comput. Stat. Data Anal..

[14]  H C EilersPaul,et al.  Generalized linear regression on sampled signals and curves , 1999 .

[15]  S. Wood Thin plate regression splines , 2003 .

[16]  R. Bro Exploratory study of sugar production using fluorescence spectroscopy and multi-way analysis , 1999 .