On the optimal reconstruction of partially observed functional data

We propose a new reconstruction operator that aims to recover the missing parts of a function given the observed parts. This new operator belongs to a new, very large class of functional operators which includes the classical regression operators as a special case. We show the optimality of our reconstruction operator and demonstrate that the usually considered regression operators generally cannot be optimal reconstruction operators. Our estimation theory allows for autocorrelated functional data and considers the practically relevant situation in which each of the $n$ functions is observed at $m$ discretization points. We derive rates of consistency for our nonparametric estimation procedures using a double asymptotic ($n\to\infty, m\to\infty$). For data situations, as in our real data application where $m$ is considerably smaller than $n$, we show that our functional principal components based estimator can provide better rates of convergence than any conventional nonparametric smoothing method.

[1]  Piotr Kokoszka,et al.  Inference for Functional Data with Applications , 2012 .

[2]  Johanna Cludius,et al.  The merit order effect of wind and photovoltaic electricity generation in Germany 2008–2016: Estimation and distributional implications , 2014 .

[3]  Sonja Wogrin,et al.  The Market Value of Variable Renewables The Effect of Solar and Wind Power Variability on their Relative Price , 2013 .

[4]  M. Wand,et al.  Multivariate Locally Weighted Least Squares Regression , 1994 .

[5]  Jane-ling Wang,et al.  Functional linear regression analysis for longitudinal data , 2005, math/0603132.

[6]  Marie-Hélène Descary Recovering covariance from functional fragments , 2017, Biometrika.

[7]  Dominik Liebl,et al.  Modeling and forecasting electricity spot prices: A functional data perspective , 2013, 1310.1628.

[8]  B. Silverman,et al.  Estimating the mean and covariance structure nonparametrically when the data are curves , 1991 .

[9]  H. Weigt Germany's Wind Energy: The Potential for Fossil Capacity Replacement and Cost Saving , 2008 .

[10]  Avishai Mandelbaum,et al.  Predicting the continuation of a function with applications to call center data , 2014 .

[11]  P. Hall,et al.  Properties of principal component methods for functional and longitudinal data analysis , 2006, math/0608022.

[12]  T. Hsing,et al.  Uniform convergence rates for nonparametric regression and principal component analysis in functional/longitudinal data , 2010, 1211.2137.

[13]  Joel L. Horowitz,et al.  Methodology and convergence rates for functional linear regression , 2007, 0708.0466.

[14]  H. Müller,et al.  Functional Data Analysis for Sparse Longitudinal Data , 2005 .

[15]  Marcel Prokopczuk,et al.  The Case of Negative Day-Ahead Electricity Prices , 2011 .

[16]  Piotr Kokoszka,et al.  Evaluation of the cooling trend in the ionosphere using functional regression with incomplete curves , 2017 .

[17]  Aurore Delaigle,et al.  Classification Using Censored Functional Data , 2013 .

[18]  Jane-Ling Wang,et al.  From sparse to dense functional data and beyond , 2016 .

[19]  Jin-Ting Zhang,et al.  Statistical inferences for functional data , 2007, 0708.2207.

[20]  R. Weron Electricity price forecasting: A review of the state-of-the-art with a look into the future , 2014 .

[21]  Dominik Liebl Nonparametric testing for differences in electricity prices: The case of the Fukushima nuclear accident , 2017, The Annals of Applied Statistics.

[22]  M. Nicolosi Wind power integration and power system flexibility–An empirical analysis of extreme events in Germany under the new negative price regime , 2010 .

[23]  T. Tony Cai,et al.  Prediction in functional linear regression , 2006 .

[24]  Aurore Delaigle,et al.  Approximating fragmented functional data by segments of Markov chains , 2016 .

[25]  D. Bosq Linear Processes in Function Spaces: Theory And Applications , 2000 .

[26]  Alexandre B. Tsybakov,et al.  Introduction to Nonparametric Estimation , 2008, Springer series in statistics.

[27]  David Kraus,et al.  Components and completion of partially observed functional data , 2015 .

[28]  P. Sarda,et al.  CLT in functional linear regression models , 2005, math/0508073.