Weak and strong uniform consistency of kernel regression estimates

SummaryWe study the estimation of a regression function by the kernel method. Under mild conditions on the “window”, the “bandwidth” and the underlying distribution of the bivariate observations {(Xi, Yi)}, we obtain the weak and strong uniform convergence rates on a bounded interval. These results parallel those of Silverman (1978) on density estimation and extend those of Schuster and Yakowitz (1979) and Collomb (1979) on regression estimation.

[1]  M. Rosenblatt.  Remarks on a Multivariate Transformation , 1952 .

[2]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[3]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[4]  E. Nadaraya.  On Estimating Regression , 1964 .

[5]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[6]  E. Nadaraya.  Remarks on Non-Parametric Estimates for Density Functions and Regression Curves , 1970 .

[7]  A. Garsia.  Continuity properties of Gaussian processes with multidimensional time parameter , 1972 .

[8]  Eugene F. Schuster,et al.  Joint Asymptotic Distribution of the Estimated Regression Function at a Finite Number of Distinct Points , 1972 .

[9]  P. Bickel,et al.  On Some Global Measures of the Deviations of Density Function Estimates , 1973 .

[10]  P. Major,et al.  An approximation of partial sums of independent RV'-s, and the sample DF. I , 1975 .

[11]  R. Reiss.  Consistency of a certain class of empirical density functions , 1975 .

[12]  P. Révész,et al.  A new method to prove strassen type laws of invariance principle. 1 , 1975 .

[13]  P. K. Bhattacharya.  An Invariance Principle in Regression Analysis , 1976 .

[14]  Kazuo Noda,et al.  Estimation of a regression function by the parzen kernel-type density estimators , 1976 .

[15]  M. Rosenblatt,et al.  On the Maximal Deviation of $k$-Dimensional Density Estimates , 1976 .

[16]  Bernard Walter Silverman.  On a Gaussian process related to multivariate probability density estimation , 1976, Mathematical Proceedings of the Cambridge Philosophical Society.

[17]  P. Révész.  On Strong Approximation of the Multidimensional Empirical Process , 1976 .

[18]  C. J. Stone,et al.  Consistent Nonparametric Regression , 1977 .

[19]  G. Tusnády,et al.  A remark on the approximation of the sample df in the multidimensional case , 1977 .

[20]  L. Devroye.  The uniform convergence of the nadaraya‐watson regression function estimate , 1978 .

[21]  V. Konakov.  On a Global Measure of Deviation for an Estimate of the Regression Line , 1978 .

[22]  B. Silverman,et al.  Weak and Strong Uniform Consistency of the Kernel Estimate of a Density and its Derivatives , 1978 .

[23]  Gordon J. Johnston.  Smooth Nonparametric Regression Analysis. , 1979 .

[24]  S. Yakowitz,et al.  Contributions to the Theory of Nonparametric Regression, with Application to System Identification , 1979 .

[25]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[26]  R. Taylor,et al.  On the uniform complete convergence of estimates for multivariate density functions and regression curves , 1980 .

[27]  P. Hall.  Laws of the iterated logarithm for nonparametric density estimators , 1981 .

[28]  G. Collomb.  Estimation Non-paramétrique de la Régression: Revue Bibliographique@@@Estimation Non-parametrique de la Regression: Revue Bibliographique , 1981 .

[29]  Y. Mack,et al.  Local Properties of k-NN Regression Estimates , 1981 .

[30]  W. Stute.  A Law of the Logarithm for Kernel Density Estimators , 1982 .