The Bayesian adaptive lasso regression.

Classical adaptive lasso regression is known to possess the oracle properties; namely, it performs as well as if the correct submodel were known in advance. However, it requires consistent initial estimates of the regression coefficients, which are generally not available in high dimensional settings. In addition, none of the algorithms used to obtain the adaptive lasso estimators provide a valid measure of standard error. To overcome these drawbacks, some Bayesian approaches have been proposed to obtain the adaptive lasso and related estimators. In this paper, we consider a fully Bayesian treatment for the adaptive lasso that leads to a new Gibbs sampler with tractable full conditional posteriors. Through simulations and real data analyses, we compare the performance of the new Gibbs sampler with some of the existing Bayesian and non-Bayesian methods. Results show that the new approach performs well in comparison to the existing Bayesian and non-Bayesian approaches.

[1]  Chris Hans.  Bayesian lasso regression , 2009 .

[2]  T. Stamey,et al.  Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate. II. Radical prostatectomy treated patients. , 1989, The Journal of urology.

[3]  Rahim Alhamzawi,et al.  Bayesian tobit quantile regression with penalty , 2018, Commun. Stat. Simul. Comput..

[4]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[5]  H. Zou.  The Adaptive Lasso and Its Oracle Properties , 2006 .

[6]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[7]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[8]  Xiaofang Xu,et al.  Bayesian Variable Selection and Estimation for Group Lasso , 2015, 1512.01013.

[9]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[10]  P. Bühlmann,et al.  The group lasso for logistic regression , 2008 .

[11]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[12]  Nengjun Yi,et al.  A New Bayesian Lasso. , 2014, Statistics and its interface.

[13]  Hua Zhou,et al.  Penalized Regression for Genome-Wide Association Screening of Sequence Data , 2011, Pacific Symposium on Biocomputing.

[14]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[15]  Qing Li,et al.  The Bayesian elastic net , 2010 .

[16]  Dries F. Benoit,et al.  Bayesian adaptive Lasso quantile regression , 2012 .

[17]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[18]  Chenlei Leng,et al.  Bayesian adaptive Lasso , 2010, Annals of the Institute of Statistical Mathematics.

[19]  G. Casella,et al.  Penalized regression, standard errors, and Bayesian lassos , 2010 .

[20]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[21]  Malay Ghosh,et al.  Bayesian Variable Selection and Estimation Based on Global-Local Shrinkage Priors , 2016, Sankhya A.