Optimal Uniform Convergence Rates and Asymptotic Normality for Series Estimators Under Weak Dependence and Weak Conditions

We show that spline and wavelet series regression estimators for weakly dependent regressors attain the optimal uniform (i.e. sup-norm) convergence rate (n/logn)−p/(2p+d) of Stone (1982), where d is the number of regressors and p is the smoothness of the regression function. The optimal rate is achieved even for heavy-tailed martingale difference errors with finite (2+(d/p))th absolute moment for d/p<2. We also establish the asymptotic normality of t statistics for possibly nonlinear, irregular functionals of the conditional mean function under weak conditions. The results are proved by deriving a new exponential inequality for sums of weakly dependent random matrices, which is of independent interest.

[1]  Jianqing Fan,et al.  Nonlinear Time Series : Nonparametric and Parametric Methods , 2005 .

[2]  D. Freedman.  On Tail Probabilities for Martingales , 1975 .

[3]  Kengo Kato,et al.  Quasi-Bayesian analysis of nonparametric instrumental variables models , 2012, 1204.2108.

[4]  William F. Moss,et al.  Decay rates for inverses of band matrices , 1984 .

[5]  Dennis Kristensen,et al.  UNIFORM CONVERGENCE RATES OF KERNEL ESTIMATORS WITH HETEROGENEOUS DEPENDENT DATA , 2009, Econometric Theory.

[6]  Alexandre B. Tsybakov,et al.  Introduction to Nonparametric Estimation , 2008, Springer series in statistics.

[7]  Xiaohong Chen,et al.  Sieve inference on possibly misspecified semi-nonparametric time series models , 2014 .

[8]  J. Zinn,et al.  Consistent specification tests for semiparametric/nonparametric models based on series estimation methods , 2003 .

[9]  M. Hoffmann,et al.  Nonparametric estimation of scalar diffusions based on low frequency data , 2002, math/0503680.

[10]  Xiaohong Chen,et al.  Estimation of Nonparametric Conditional Moment Models with Possibly Nonsmooth Generalized Residuals , 2009 .

[11]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[12]  W. Newey,et al.  Convergence rates and asymptotic normality for series estimators , 1997 .

[13]  Haipeng Shen,et al.  Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach , 2004 .

[14]  Xiaohong Chen,et al.  Optimal Uniform Convergence Rates for Sieve Nonparametric Instrumental Variables Regression , 2013, 1311.0412.

[15]  D. McLeish.  Dependent Central Limit Theorems and Invariance Principles , 1974 .

[16]  Xiaohong Chen.  Penalized Sieve Estimation and Inference of Semi-Nonparametric Dynamic Models: A Selective Review , 2011 .

[17]  P. Robinson,et al.  Hypothesis Testing in Semiparametric and Nonparametric Models for Econometric Time Series , 1989 .

[18]  Dag Tjøstheim,et al.  Nonparametric Identification of Nonlinear Time Series: Projections , 1994 .

[19]  Qi Li,et al.  Nonparametric Econometrics: Theory and Practice , 2006 .

[20]  Kyungchul Song.  UNIFORM CONVERGENCE OF SERIES ESTIMATORS OVER FUNCTION SPACES , 2008, Econometric Theory.

[21]  Max H. Farrell,et al.  Optimal convergence rates, Bahadur representation, and asymptotic normality of partitioning estimators☆ , 2013 .

[22]  Xiaohong Chen,et al.  ON RATE OPTIMALITY FOR ILL-POSED INVERSE PROBLEMS IN ECONOMETRICS , 2007, Econometric Theory.

[23]  Joel A. Tropp,et al.  User-Friendly Tail Bounds for Sums of Random Matrices , 2010, Found. Comput. Math..

[24]  Jianhua Z. Huang,et al.  Identification of non‐linear additive autoregressive models , 2004 .

[25]  Qi Li,et al.  Consistent Specification Tests for Semiparametric / Nonparametric Models Based on Series Estimation Methods ∗ , 2003 .

[26]  Jungyoon Lee,et al.  Series estimation under cross-sectional dependence , 2013 .

[27]  I. Daubechies,et al.  Wavelets on the Interval and Fast Wavelet Transforms , 1993 .

[28]  Jianhua Z. Huang.  Asymptotics for polynomial spline regression under weak conditions , 2003 .

[29]  Jianhua Z. Huang.  Projection estimation in multiple regression with application to functional ANOVA models , 1998 .

[30]  Xiaotong Shen,et al.  Sieve extremum estimates for weakly dependent data , 1998 .

[31]  Zhipeng Liao,et al.  Sieve M inference on irregular parameters , 2014 .

[32]  H. Berbee,et al.  Convergence rates in the strong law for bounded mixing sequences , 1984 .

[33]  Kengo Kato,et al.  Some new asymptotic theory for least squares series: Pointwise and uniform results , 2012, 1212.0442.

[34]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[35]  D. Andrews.  Asymptotic Normality of Series Estimators for Nonparametric and Semiparametric Regression Models , 1991 .

[36]  Elias Masry,et al.  MULTIVARIATE LOCAL POLYNOMIAL REGRESSION FOR TIME SERIES:UNIFORM STRONG CONSISTENCY AND RATES , 1996 .

[37]  Xiaohong Chen.  Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models , 2007 .

[38]  R. Jong.  A note on "Convergence rates and asymptotic normality for series estimators": uniform convergence rates , 2002 .

[39]  B. Hansen.  UNIFORM CONVERGENCE RATES FOR KERNEL ESTIMATION WITH DEPENDENT DATA , 2008, Econometric Theory.

[40]  D. Pollard.  Convergence of stochastic processes , 1984 .

[41]  Jianhua Z. Huang.  Local asymptotics for polynomial spline regression , 2003 .

[42]  R. C. Bradley.  Basic properties of strong mixing conditions. A survey and some open questions , 2005, math/0511078.

[43]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.

[44]  L. Schumaker.  Spline Functions: Basic Theory , 1981 .