Estimating the conditional distribution in functional regression problems

We consider the problem of consistently estimating the conditional distribution P (Y ∈ A|X) of a functional data object Y = (Y (t) : t ∈ [0, 1]) given covariates X in a general space, assuming that Y and X are related by a functional linear regression model. Two natural estimation methods are proposed, based on either bootstrapping the estimated model residuals, or fitting functional parametric models to the model residuals and estimating P (Y ∈ A|X) via simulation. Whether either of these methods lead to consistent estimation depends on the consistency properties of the regression operator estimator, and the space within which Y is viewed. We show that under general consistency conditions on the regression operator estimator, which hold for certain functional principal component based estimators, consistent estimation of the conditional distribution can be achieved, both when Y is an element of a separable Hilbert space, and when Y is an element of the Banach space of continuous functions. The latter results imply that sets A that specify path properties of Y , which are of interest in applications, can be considered. The proposed methods are studied in several simulation experiments, and data analyses of electricity price and pollution curves.

[1]  Jianing Fan,et al.  Conditional distribution regression for functional responses , 2021, Scandinavian Journal of Statistics.

[2]  Estimation of the noise covariance operator in functional linear regression with functional outputs , 2016 .

[3]  Masaaki Imaizumi,et al.  PCA-based estimation for functional linear regression with functional responses , 2016, J. Multivar. Anal..

[4]  V. Chernozhukov,et al.  QUANTILE AND PROBABILITY CURVES WITHOUT CROSSING , 2007, 0704.3649.

[5]  E. Bulinskaya On the Mean Number of Crossings of a Level by a Stationary Gaussian Process , 1961 .

[6]  H. Brezis Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[7]  P. Kokoszka,et al.  Weakly dependent functional data , 2010, 1010.0792.

[8]  Antonio Muñoz San Roque,et al.  Forecasting Functional Time Series with a New Hilbertian ARMAX Model: Application to Electricity Price Forecasting , 2018, IEEE Transactions on Power Systems.

[9]  Kengo Kato,et al.  Estimation in functional linear quantile regression , 2012, 1202.4850.

[10]  M. Reimherr,et al.  Fast and Fair Simultaneous Confidence Bands for Functional Parameters. , 2019, 1910.00131.

[11]  J. Azaïs,et al.  Level Sets and Extrema of Random Processes and Fields , 2009 .

[12]  Charles Suquet Tightness in Schauder decomposable Banach spaces∗ , 2005 .

[13]  D. Bosq Linear Processes in Function Spaces: Theory And Applications , 2000 .

[14]  H. Muller,et al.  Generalized functional linear models , 2005, math/0505638.

[15]  C. Crainiceanu,et al.  Corrected Confidence Bands for Functional Data Using Principal Components , 2013, Biometrics.

[16]  H. Müller,et al.  FUNCTIONAL RESPONSE MODELS , 2004 .

[17]  Ingrid Van Keilegom,et al.  Regression when both response and predictor are functions , 2012, J. Multivar. Anal..

[18]  Christophe Crambes,et al.  Asymptotics of prediction in functional linear regression with functional outputs , 2009, 0910.3070.

[19]  R. Bass,et al.  Review: P. Billingsley, Convergence of probability measures , 1971 .

[20]  Jiguo Cao,et al.  Functional single-index quantile regression models , 2020, Stat. Comput..

[21]  David E. Tyler,et al.  A characterization of elliptical distributions and some optimality properties of principal components for functional data , 2014, J. Multivar. Anal..

[22]  A. Aue,et al.  Functional data analysis in the Banach space of continuous functions , 2017, The Annals of Statistics.

[23]  Hans-Georg Müller,et al.  Functional Data Analysis , 2016 .

[24]  Alain Berlinet,et al.  Local linear regression for functional data , 2007, 0710.5218.

[25]  Siegfried Hörmann,et al.  On the Prediction of Stationary Functional Time Series , 2012, 1208.2892.

[26]  M. Reimherr,et al.  A geometric approach to confidence regions and bands for functional parameters , 2016, 1607.07771.

[27]  Hans-Georg Müller,et al.  Modeling Conditional Distributions for Functional Responses, With Application to Traffic Monitoring via GPS-Enabled Mobile Phones , 2014, Technometrics.

[28]  André Mas Weak convergence in the functional autoregressive model , 2005, math/0509256.

[29]  E. Paparoditis,et al.  Incorporating Model Uncertainty in the Construction of Bootstrap Prediction Intervals for Functional Time Series , 2020 .

[30]  Besnik Pumo,et al.  Prediction of Continuous Time Processes by C[0,1]‐Valued Autoregressive Process , 1998 .

[31]  Soumendu Sundar Mukherjee Weak convergence and empirical processes , 2019 .

[32]  Fan Wang,et al.  Regularized partially functional quantile regression , 2017, J. Multivar. Anal..

[33]  Z. Q. John Lu,et al.  Nonparametric Functional Data Analysis: Theory And Practice , 2007, Technometrics.

[34]  Kehui Chen,et al.  Conditional quantile analysis when covariates are functions, with application to growth data , 2012 .

[35]  H. Sørensen,et al.  Multinomial functional regression with wavelets and LASSO penalization , 2017 .

[36]  María Dolores Ruiz-Medina,et al.  Strongly consistent autoregressive predictors in abstract Banach spaces , 2018, J. Multivar. Anal..

[37]  M. Talagrand Upper and Lower Bounds for Stochastic Processes: Modern Methods and Classical Problems , 2014 .

[38]  Belén Fernández de Castro,et al.  Functional Samples and Bootstrap for Predicting Sulfur Dioxide Levels , 2005, Technometrics.

[39]  Nadia L. Kudraszow,et al.  Uniform consistency of kNN regressors for functional variables , 2013 .

[40]  Siegfried Hormann,et al.  A Note on Estimation in Hilbertian Linear Models , 2012, 1208.2895.

[41]  J. O. Ramsay,et al.  Functional Data Analysis (Springer Series in Statistics) , 1997 .

[42]  Ricardo Cao,et al.  Forecasting next-day electricity demand and price using nonparametric functional methods , 2012 .

[43]  Han Lin Shang,et al.  Forecasting functional time series , 2009 .