Methods for estimating a conditional distribution function

Motivated by the problem of setting prediction intervals in time series analysis, we suggest two new methods for conditional distribution estimation. The first method is based on locally fitting a logistic model and is in the spirit of recent work on locally parametric techniques in density estimation. It produces distribution estimators that may be of arbitrarily high order but nevertheless always lie between 0 and 1. The second method involves an adjusted form of the Nadaraya--Watson estimator. It preserves the bias and variance properties of a class of second-order estimators introduced by Yu and Jones but has the added advantage of always being a distribution itself. Our methods also have application outside the time series setting; for example, to quantile estimation for independent data. This problem motivated the work of Yu and Jones.

[1]  Magda Peligrad,et al.  Recent advances in the central limit theorem and its weak invariance principle for mixing sequences , 1986 .

[2]  James Stephen Marron,et al.  Kernel Quantile Estimators , 1990 .

[3]  Interpolation methods for adapting to sparse design in nonparametric regression. Comment. Rejoinder , 1997 .

[4]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[5]  Jianqing Fan,et al.  Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems , 1996 .

[6]  C. Loader.  Local Likelihood Density Estimation , 1996 .

[7]  T. Gasser,et al.  Variance Properties of Local Polynomials and Ensuing Modifications , 1996 .

[8]  J. B. Copas,et al.  Local Likelihood Based on Kernel Censoring , 1995 .

[9]  James Stephen Marron,et al.  Choosing a Kernel Regression Estimator , 1991 .

[10]  B. Presnell,et al.  Intentionally biased bootstrap methods , 1999 .

[11]  Jianqing Fan.  Local Linear Regression Smoothers and Their Minimax Efficiencies , 1993 .

[12]  Rosa L. Matzkin.  Nonparametric and Distribution-Free Estimation of the Binary Threshold Crossing and the Binary Choice Models , 1992 .

[13]  Qiwei Yao,et al.  Nonparametric estimation of ratios of noise to signal in stochastic regression , 2000 .

[14]  P. Bertail,et al.  The Weighted Bootstrap , 1995 .

[15]  Specification tests for binary choice models based on index quantiles , 1993 .

[16]  Berwin A. Turlach,et al.  Interpolation Methods for Adapting to Sparse Design in Nonparametric Regression , 1997 .

[17]  P. K. Bhattacharya,et al.  Kernel and Nearest-Neighbor Estimation of a Conditional Quantile , 1990 .

[18]  M. C. Jones,et al.  Mean squared error properties of kernel estimates or regression quantiles , 1990 .

[19]  M. C. Jones,et al.  Locally parametric nonparametric density estimation , 1996 .

[20]  C. K. Chu,et al.  Nonparametric regression estimates using misclassified binary responses , 1995 .

[21]  J. Simonoff.  Smoothing Methods in Statistics , 1998 .

[22]  K. Yoshihara.  Limiting behavior of U-statistics for stationary, absolutely regular processes , 1976 .

[23]  Charles F. Manski,et al.  Distribution theory for the analysis of binary choice under uncertainty with nonparametric estimation of expectations , 1993 .

[24]  Hyungtaik Ahn.  Nonparametric two-stage estimation of conditional choice probabilities in a binary choice model under uncertainty , 1995 .

[25]  M. C. Jones,et al.  Local Linear Quantile Regression , 1998 .

[26]  M. Wand,et al.  Multivariate Locally Weighted Least Squares Regression , 1994 .