Lasso variable selection in functional regression

Functional Regression has been an active subject of research in the last two decades but still lacks a secure variable selection methodology. Lasso is a well known effective technique for parameters shrinkage and variable selection in regression problems. In this work we generalize the Lasso technique to select variables in the functional regression framework and show it performs well. In particular, we focus on the case of functional regression with scalar regressors and functional response. Reduce the associated functional optimization problem to a convex optimization on scalars. Find its solutions and stress their interpretability. We apply the technique to simulated data sets as well as to a new real data set: car velocity functions in low speed car accidents, a frequent cause of whiplash injuries. By “Functional Lasso” we discover which car characteristics influence more car speed and which can be considered not relevant

[1]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[2]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[3]  J. Faraway Regression analysis for a functional response , 1997 .

[4]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[5]  James O. Ramsay,et al.  Applied Functional Data Analysis: Methods and Case Studies , 2002 .

[6]  Julian J. Faraway,et al.  An F test for linear models with functional responses , 2004 .

[7]  P. Vieu,et al.  Nonparametric Functional Data Analysis: Theory and Practice (Springer Series in Statistics) , 2006 .

[8]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[9]  R. Ipanaqué,et al.  Symbolic Manipulation of Bspline Basis Functions with Mathematica , 2007, International Conference on Computational Science.

[10]  Manuel Febrero Bande A present overview on functional data analysis , 2008 .

[11]  T. Hesterberg,et al.  Least angle and ℓ1 penalized regression: A review , 2008, 0802.0964.

[12]  H. Lian,et al.  Inference of Genetic Networks from Time Course Expression Data Using Functional Regression with Lasso Penalty , 2008, Communications in Statistics - Theory and Methods.

[13]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[14]  Sadanori Konishi,et al.  Variable selection for functional regression models via the L1 regularization , 2011, Comput. Stat. Data Anal..

[15]  R Todd Ogden,et al.  Wavelet-Based LASSO in Functional Linear Regression , 2012, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.