Likelihood Based Inference for Quantile Regression Using the Asymmetric Laplace Distribution

To make inferences about the shape of a population distribution, the widely p opular mean regression model, for example, is inadequate if the distribution is not approx imately Gaussian (or symmetric). Compared to conventional mean regression (MR), quantile r egr ssion (QR) can characterize the entire conditional distribution of the outcome variable, a nd is more robust to outliers and misspecification of the error distribution. We present a lik elihood-based approach to the estimation of the regression quantiles based on the asymmetric L apla e distribution (ALD), a choice that turns out to be natural in this context. The ALD h as a nice hierarchical representation which facilitates the implementation of the EM algorithm for ma ximumlikelihood estimation of the parameters at the pth level with the observed information matrix as a byproduct. Inspired by the EM algorithm, we develop case-deletion dia g ostics analysis for QR models, following the approach of Zhu et al. (2001). This is becau se the observed data log–likelihood function associated with the proposed model is somewhat c omplex (e.g., not differentiable at zero) and by using Cook’s well-known approach it an be very difficult to obtain case-deletion measures. The techniques are illustrated with both simula ted and real data. In particular, in an empirical comparison, our approach out-perfo rmed other common classic estimators under a wide array of simulated data models and is flexible eno ugh to easily accommodate changes in their assumed distribution. The proposed algorithm a nd methods are implemented in the R package ALDqr().

[1]  Narayanaswamy Balakrishnan,et al.  Influence analyses of skew-normal/independent linear mixed models , 2010, Comput. Stat. Data Anal..

[2]  R. Dennis Cook,et al.  Detection of Influential Observation in Linear Regression , 2000, Technometrics.

[3]  Samuel Kotz,et al.  The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance , 2001 .

[4]  A. Kottas,et al.  Bayesian Semiparametric Modelling in Quantile Regression , 2009 .

[5]  S. Weisberg,et al.  Residuals and Influence in Regression , 1982 .

[6]  Manuel González,et al.  Influence diagnostics in the tobit censored response model , 2010, Stat. Methods Appl..

[7]  Keming Yu,et al.  Bayesian quantile regression , 2001 .

[8]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[9]  H. Kozumi,et al.  Gibbs sampling methods for Bayesian quantile regression , 2011 .

[10]  Narayanaswamy Balakrishnan,et al.  Influence diagnostics in linear and nonlinear mixed-effects models with censored data , 2013, Comput. Stat. Data Anal..

[11]  Keming Yu,et al.  A Three-Parameter Asymmetric Laplace Distribution and Its Extension , 2005 .

[12]  A. Gelfand,et al.  Bayesian Semiparametric Median Regression Modeling , 2001 .

[13]  Sik-Yum Lee,et al.  Local influence for incomplete data models , 2001 .

[14]  I. Barrodale,et al.  Algorithms for restricted least absolute value estimation , 1977 .

[15]  R. Koenker,et al.  Regression Quantiles , 2007 .

[16]  R. Koenker,et al.  Computing regression quantiles , 1987 .

[17]  R. Cook Assessment of Local Influence , 1986 .

[18]  N. Shephard,et al.  Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics , 2001 .

[19]  Bo-Cheng Wei,et al.  Case-deletion measures for models with incomplete data , 2001 .