Kernel estimation of discontinuous regression functions

A kernel regression estimator is proposed wherein the regression function is smooth, except possibly for a finite number of points of discontinuity. The proposed estimator uses preliminary estimators for the location and size of discontinuities or change-points in an otherwise smooth regression model and then uses an ordinary kernel regression estimator based on suitably adjusted data. Global L2 rates of convergence of curve estimates are derived. It is shown that these rates of convergence are the same as those for ordinary kernel regression estimators of smooth curves. Moreover, pointwise asymptotic normality is also obtained. The finite-sample performance of the proposed method is illustrated by simulated examples.

[1]  K. Gordon,et al.  Modeling and Monitoring Biomedical Time Series , 1990 .

[2]  F. Lombard.  Detecting change points by Fourier analysis , 1988 .

[3]  H. Müller.  Nonparametric regression analysis of longitudinal data , 1988 .

[4]  Heping Zhang,et al.  Maximal Correlation and Adaptive Splines , 1994 .

[5]  Ja-Yong Koo,et al.  Spline Estimation of Discontinuous Regression Functions , 1997 .

[6]  D. Hinkley.  Inference about the intersection in two-phase regression , 1969 .

[7]  R. Eubank,et al.  Nonparametric estimation of functions with jump discontinuities , 1994 .

[8]  Stéphane Mallat,et al.  Singularity detection and processing with wavelets , 1992, IEEE Trans. Inf. Theory.

[9]  J. Friedman.  Multivariate adaptive regression splines , 1990 .

[10]  G. Cobb.  The problem of the Nile: Conditional solution to a changepoint problem , 1978 .

[11]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[12]  Yazhen Wang.  Jump and sharp cusp detection by wavelets , 1995 .

[13]  H. Müller,et al.  Statistical methods for DNA sequence segmentation , 1998 .

[14]  Edward Carlstein,et al.  Change-point problems , 1994 .

[15]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[16]  Bernard W. Silverman,et al.  The discrete wavelet transform in S , 1994 .

[17]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[18]  H. Müller.  CHANGE-POINTS IN NONPARAMETRIC REGRESSION ANALYSIS' , 1992 .

[19]  John Alan McDonald,et al.  Smoothing with split linear fits , 1986 .

[20]  Y. Yin,et al.  Detection of the number, locations and magnitudes of jumps , 1988 .

[21]  William H. Press,et al.  Numerical Recipes: FORTRAN , 1988 .

[22]  Leo Breiman,et al.  Fitting additive models to regression data , 1993, Computational Statistics & Data Analysis.

[23]  C. Chui,et al.  Wavelets : theory, algorithms, and applications , 1994 .

[24]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[25]  Steve C. A. Peters,et al.  Comparing Automatic Smoothers (A Public Service Enterprise) , 1992 .

[26]  Naomi Altman,et al.  Kernel Smoothing of Data with Correlated Errors , 1990 .

[27]  P. Hall,et al.  Edge-preserving and peak-preserving smoothing , 1992 .

[28]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[29]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[30]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[31]  Jerome H. Friedman.  Multivariate adaptive regression splines (with discussion) , 1991 .

[32]  C. Loader.  CHANGE POINT ESTIMATION USING NONPARAMETRIC REGRESSION , 1996 .

[33]  D. Donoho.  On Minimum Entropy Segmentation , 1994 .

[34]  Y. Yatracos.  A Lower Bound on the Error in Nonparametric Regression Type Problems , 1988 .

[35]  Marc Raimondo,et al.  Minimax estimation of sharp change points , 1998 .

[36]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[37]  J. Friedman,et al.  FLEXIBLE PARSIMONIOUS SMOOTHING AND ADDITIVE MODELING , 1989 .

[38]  P. Hall,et al.  Asymptotically optimal difference-based estimation of variance in nonparametric regression , 1990 .

[39]  Youngjo Lee,et al.  Bivariate B-splines in generalised linear models , 1994 .