Asymptotic validity of bootstrap confidence intervals in nonparametric regression without an additive model

Bootstrap for nonparametric regression has been around for more than 30 years. Nevertheless, most results are based on assuming an additive regression model with respect to independent and identical (i.i.d.) errors. An exception is the Local Bootstrap of Shi [23] for which, however, no bootstrap consistency results are available. We attempt to remedy this here while at the same time showing bootstrap consistency for a more general class of methods that fall under the heading of Model-free Bootstrap of Politis [18].

[1]  John E. Angus,et al.  The Probability Integral Transform and Related Results , 1994, SIAM Rev..

[2]  M. Chavance.  [Jackknife and bootstrap]. , 1992, Revue d'epidemiologie et de sante publique.

[3]  Zhongjun Qu,et al.  Nonparametric estimation and inference on conditional quantile processes , 2015 .

[4]  D. Politis.  Model-Free Prediction and Regression: A Transformation-Based Approach to Inference , 2015 .

[5]  David Ruppert,et al.  Bias reduction in kernel density estimation by smoothed empirical transformations , 1994 .

[6]  Elias Masry,et al.  MULTIVARIATE LOCAL POLYNOMIAL REGRESSION FOR TIME SERIES:UNIFORM STRONG CONSISTENCY AND RATES , 1996 .

[7]  E. Nadaraya.  On Estimating Regression , 1964 .

[8]  Dimitris N. Politis,et al.  Model-free model-fitting and predictive distributions , 2010 .

[9]  D. Politis.  Model-free vs . Model-based Volatility Prediction ∗ , 2006 .

[10]  Jeffrey S. Racine,et al.  Nonparametric Estimation of Conditional CDF and Quantile Functions With Mixed Categorical and Continuous Data , 2008 .

[11]  E. Mammen.  The Bootstrap and Edgeworth Expansion , 1997 .

[12]  M. Priestley,et al.  Non‐Parametric Function Fitting , 1972 .

[13]  W. Härdle,et al.  Bootstrapping in Nonparametric Regression: Local Adaptive Smoothing and Confidence Bands , 1988 .

[14]  Sheng G. Shi.  Local bootstrap , 1991 .

[15]  Yingcun Xia,et al.  UNIFORM BAHADUR REPRESENTATION FOR LOCAL POLYNOMIAL ESTIMATES OF M-REGRESSION AND ITS APPLICATION TO THE ADDITIVE MODEL , 2007, Econometric Theory.

[16]  David Ruppert,et al.  Asymptotics for the Transformation Kernel Density Estimator , 1995 .

[17]  S. Sperlich.  Comments on: Model-free model-fitting and predictive distributions , 2013 .

[18]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[19]  L. Devroye.  The uniform convergence of the nadaraya‐watson regression function estimate , 1978 .

[20]  D. Politis.  Bootstrap Confidence Intervals in Nonparametric Regression Without an Additive Model , 2014 .

[21]  Model-Free Bootstrap for Markov processes , 2015 .

[22]  Joseph P. Romano,et al.  On Subsampling Estimators with Unknown Rate of Convergence , 1999 .