Functional linear regression after spline transformation

Functional linear regression has been widely used to model the relationship between a scalar response and functional predictors. If the original data do not satisfy the linear assumption, an intuitive solution is to perform some transformation such that transformed data will be linearly related. The problem of finding such transformations has been rather neglected in the development of functional data analysis tools. In this paper, we consider transformation on the response variable in functional linear regression and propose a nonparametric transformation model in which we use spline functions to construct the transformation function. The functional regression coefficients are then estimated by an innovative procedure called mixed data canonical correlation analysis (MDCCA). MDCCA is analogous to the canonical correlation analysis between two multivariate samples, but is between a multivariate sample and a set of functional data. Here, we apply the MDCCA to the projection of the transformation function on the B-spline space and the functional predictors. We then show that our estimates agree with the regularized functional least squares estimate for the transformation model subject to a scale multiplication. The dimension of the space of spline transformations can be determined by a model selection principle. Typically, a very small number of B-spline knots is needed. Real and simulation data examples are further presented to demonstrate the value of this approach.

[1]  T. Tony Cai,et al.  Prediction in functional linear regression , 2006 .

[2]  James O. Ramsay,et al.  Functional Data Analysis , 2005 .

[3]  T. Fearn,et al.  Application of near infrared reflectance spectroscopy to the compositional analysis of biscuits and biscuit doughs , 1984 .

[4]  T. Fearn,et al.  Bayesian Wavelet Regression on Curves With Application to a Spectroscopic Calibration Problem , 2001 .

[5]  L. Ferré,et al.  Functional sliced inverse regression analysis , 2003 .

[6]  J. Ramsay,et al.  Some Tools for Functional Data Analysis , 1991 .

[7]  F. Ferraty,et al.  The Oxford Handbook of Functional Data Analysis , 2011, Oxford Handbooks Online.

[8]  Philippe Vieu,et al.  Nonparametric time series prediction: A semi-functional partial linear modeling , 2008 .

[9]  H. Müller,et al.  Functional Data Analysis for Sparse Longitudinal Data , 2005 .

[10]  P. Vieu,et al.  NONPARAMETRIC REGRESSION ON FUNCTIONAL DATA: INFERENCE AND PRACTICAL ASPECTS , 2007 .

[11]  Tatiyana V. Apanasovich,et al.  Weighted least squares methods for prediction in the functional data linear model , 2009 .

[12]  P. Vieu,et al.  Rate of uniform consistency for nonparametric estimates with functional variables , 2010 .

[13]  P. Sarda,et al.  SPLINE ESTIMATORS FOR THE FUNCTIONAL LINEAR MODEL , 2003 .

[14]  Xuming He,et al.  Linear regression after spline transformation , 1997 .

[15]  L. Ferré,et al.  Multilayer Perceptron with Functional Inputs: an Inverse Regression Approach , 2006, 0705.0211.

[16]  M. L. Eaton,et al.  The Non-Singularity of Generalized Sample Covariance Matrices , 1973 .

[17]  P. Vieu,et al.  Nonparametric Functional Data Analysis: Theory and Practice (Springer Series in Statistics) , 2006 .

[18]  James O. Ramsay,et al.  Applied Functional Data Analysis: Methods and Case Studies , 2002 .

[19]  W. González-Manteiga,et al.  Bootstrap in functional linear regression , 2011 .

[20]  Frédéric Ferraty,et al.  The Functional Nonparametric Model and Application to Spectrometric Data , 2002, Comput. Stat..

[21]  Frédéric Ferraty,et al.  Cross-validated estimations in the single-functional index model , 2008 .

[22]  M. Yuan,et al.  A Reproducing Kernel Hilbert Space Approach to Functional Linear Regression , 2010, 1211.2607.

[23]  Chun-Houh Chen,et al.  CAN SIR BE AS POPULAR AS MULTIPLE LINEAR REGRESSION , 2003 .

[24]  Jane-Ling Wang,et al.  Functional quasi‐likelihood regression models with smooth random effects , 2003 .

[25]  B. Silverman,et al.  Canonical correlation analysis when the data are curves. , 1993 .

[26]  R. Tibshirani,et al.  Penalized Discriminant Analysis , 1995 .

[27]  A. Laksaci,et al.  Robust nonparametric estimation for functional data , 2008 .