A robust and efficient estimation method for single index models

Single index models are natural extensions of linear models and overcome the so-called curse of dimensionality. They have applications to many fields, such as medicine, economics and finance. However, most existing methods based on least squares or likelihood are sensitive when there are outliers or the error distribution is heavy tailed. Although an M-type regression is often considered as a good alternative to those methods, it may lose efficiency for normal errors. In this paper, we propose a new robust and efficient estimation procedure based on local modal regression for single index models. The asymptotic normality of proposed estimators for both the parametric and nonparametric parts is established. We show that the proposed estimators are as asymptotically efficient as the least-square-based estimators when there are no outliers and the error distribution is normal. A modified EM algorithm is presented for efficient implementation. The simulations and real data analysis are conducted to illustrate the finite sample performance of the proposed method.

[1]  H. Tong,et al.  Article: 2 , 2002, European Financial Services Law.

[2]  Yan Yu,et al.  Single-index quantile regression , 2010, J. Multivar. Anal..

[3]  Heng Lian,et al.  Bias-corrected GEE estimation and smooth-threshold GEE variable selection for single-index models with clustered data , 2011, J. Multivar. Anal..

[4]  Thomas M. Stoker,et al.  Semiparametric Estimation of Index Coefficients , 1989 .

[5]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[6]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[7]  Myoung-jae Lee,et al.  QUADRATIC MODE REGRESSION , 1993 .

[8]  B. Presnell,et al.  Nonparametric estimation of the mode of a distribution of random curves , 1998 .

[9]  Probal Chaudhuri,et al.  Nonparametric Estimates of Regression Quantiles and Their Local Bahadur Representation , 1991 .

[10]  Jianqing Fan,et al.  Generalized Partially Linear Single-Index Models , 1997 .

[11]  W. Härdle,et al.  Semi-parametric estimation of partially linear single-index models , 2006 .

[12]  Peter J. Bickel,et al.  SOME PROBLEMS ON THE ESTIMATION OF UNIMODAL DENSITIES , 1996 .

[13]  P. Hall,et al.  NONPARAMETRIC KERNEL REGRESSION SUBJECT TO MONOTONICITY CONSTRAINTS , 2001 .

[14]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[15]  Heping Zhang,et al.  Robust Variable Selection With Exponential Squared Loss , 2013, Journal of the American Statistical Association.

[16]  Runze Li,et al.  Local modal regression , 2012, Journal of nonparametric statistics.

[17]  Thomas M. Stoker,et al.  Investigating Smooth Multiple Regression by the Method of Average Derivatives , 2015 .

[18]  W. Härdle,et al.  Optimal Smoothing in Single-index Models , 1993 .

[19]  T. Dalenius The Mode—A Neglected Statistical Parameter , 1965 .