On Semiparametric Mode Regression Estimation

It has been found that, for a variety of probability distributions, there is a surprising linear relation between mode, mean, and median. In this article, the relation between mode, mean, and median regression functions is assumed to follow a simple parametric model. We propose a semiparametric conditional mode (mode regression) estimation for an unknown (unimodal) conditional distribution function in the context of regression model, so that any m-step-ahead mean and median forecasts can then be substituted into the resultant model to deliver m-step-ahead mode prediction. In the semiparametric model, Least Squared Estimator (LSEs) for the model parameters and the simultaneous estimation of the unknown mean and median regression functions by the local linear kernel method are combined to infer about the parametric and nonparametric components of the proposed model. The asymptotic normality of these estimators is derived, and the asymptotic distribution of the parameter estimates is also given and is shown to follow usual parametric rates in spite of the presence of the nonparametric component in the model. These results are applied to obtain a data-based test for the dependence of mode regression over mean and median regression under a regression model.

[1]  M. Samanta,et al.  Non-parametric estimation of conditional quantiles , 1989 .

[2]  R. R. Bahadur.  A Note on Quantiles in Large Samples , 1966 .

[3]  J. Marron,et al.  Smoothed cross-validation , 1992 .

[4]  D. W. Scott,et al.  Biased and Unbiased Cross-Validation in Density Estimation , 1987 .

[5]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[6]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[7]  Peter J. Bickel,et al.  SOME PROBLEMS ON THE ESTIMATION OF UNIMODAL DENSITIES , 1996 .

[8]  Jianqing Fan,et al.  Variable Bandwidth and Local Linear Regression Smoothers , 1992 .

[9]  W. Eddy.  Optimum Kernel Estimators of the Mode , 1980 .

[10]  Zudi Lu,et al.  Local Linear Additive Quantile Regression , 2004 .

[11]  J. Beirlant,et al.  Nonparametric Estimation of Conditional Quantiles , 2005 .

[12]  Ibrahim A. Ahmad,et al.  Data based bandwidth selection in kernel density estimation with parametric start via kernel contrasts , 2004 .

[13]  P. Hall,et al.  On the minimisation of $L\sp p$ error in mode estimation , 1995 .

[14]  Ulrich Stadtmüller,et al.  Estimation of Heteroscedasticity in Regression Analysis , 1987 .

[15]  M. C. Jones,et al.  A Brief Survey of Bandwidth Selection for Density Estimation , 1996 .

[16]  U. Grenander.  On the theory of mortality measurement , 1956 .

[17]  A. Berlinet,et al.  Normalité asymptotique d'estimateurs convergents du mode conditionnel , 1998 .

[18]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[19]  Liang Peng,et al.  REGRESSION MODELING FOR NONPARAMETRIC ESTIMATION OF DISTRIBUTION AND QUANTILE FUNCTIONS , 2002 .

[20]  Cun-Hui Zhang,et al.  Least squares estimators of the mode of a unimodal regression function , 2001 .

[21]  Hans-Georg Müller,et al.  On a Semiparametric Variance Function Model and a Test for Heteroscedasticity , 1995 .

[22]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[23]  M. C. Jones,et al.  A reliable data-based bandwidth selection method for kernel density estimation , 1991 .

[24]  Klaus Ziegler,et al.  On the asymptotic normality of kernel regression estimators of the mode in the nonparametric random design model , 2003 .

[25]  Klaus Ziegler,et al.  On nonparametric kernel estimation of the mode of the regression function in the random design model , 2002 .

[26]  L. Joseph,et al.  Bayesian Statistics: An Introduction , 1989 .

[27]  A. Bowman.  An alternative method of cross-validation for the smoothing of density estimates , 1984 .

[28]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[29]  Myoung-jae Lee,et al.  QUADRATIC MODE REGRESSION , 1993 .

[30]  Aerambamoorthy Thavaneswaran,et al.  Non-parametric estimation of the conditional mode , 1990 .

[31]  M. C. Jones,et al.  On optimal data-based bandwidth selection in kernel density estimation , 1991 .

[32]  Alain Berlinet,et al.  Asymptotic normality of convergent estimates of conditional quantiles , 2001 .

[33]  B. Presnell,et al.  Nonparametric estimation of the mode of a distribution of random curves , 1998 .

[34]  L. Birge,et al.  Estimation of unimodal densities without smoothness assumptions , 1997 .

[35]  Mary C. Meyer.  AN ALTERNATIVE UNIMODAL DENSITY ESTIMATOR WITH A CONSISTENT ESTIMATE OF THE MODE , 1999 .

[36]  M. C. Jones,et al.  Local Linear Quantile Regression , 1998 .

[37]  James Stephen Marron,et al.  Lower bounds for bandwidth selection in density estimation , 1991 .

[38]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[39]  Prachi Shah,et al.  BMC Bioinformatics Methodology article Comparison of mode estimation methods and application in molecular clock analysis , 2003 .

[40]  M. Rudemo.  Empirical Choice of Histograms and Kernel Density Estimators , 1982 .