Bayesian Adaptive Lasso for Ordinal Regression With Latent Variables

We consider an ordinal regression model with latent variables to investigate the effects of observable and latent explanatory variables on the ordinal responses of interest. Each latent variable is characterized by correlated observed variables through a confirmatory factor analysis model. We develop a Bayesian adaptive lasso procedure to conduct simultaneous estimation and variable selection. Nice features including empirical performance of the proposed methodology are demonstrated by simulation studies. The model is applied to a study on happiness and its potential determinants from the Inter-university Consortium for Political and Social Research.

[1]  Hongtu Zhu,et al.  Bayesian Lasso for Semiparametric Structural Equation Models , 2012, Biometrics.

[2]  A Unified Maximum Likelihood Approach for Analyzing Structural Equation Models With Missing Nonstandard Data , 2007 .

[3]  T. Oshio,et al.  Income inequality, perceived happiness, and self-rated health: evidence from nationwide surveys in Japan. , 2010, Social science & medicine.

[4]  P. McCullagh.  Regression Models for Ordinal Data , 1980 .

[5]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[6]  Jeroen K. Vermunt,et al.  Micro–Macro Multilevel Analysis for Discrete Data , 2013 .

[7]  D. A. Kenny,et al.  Estimating the nonlinear and interactive effects of latent variables. , 1984 .

[8]  Sumio Watanabe,et al.  Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory , 2010, J. Mach. Learn. Res..

[9]  S. Stack,et al.  Marital status and happiness : A 17-nation study , 1998 .

[10]  Jeffrey H. Greenhaus,et al.  Sources of Conflict Between Work and Family Roles , 1985 .

[11]  Hai-Bin Wang,et al.  Latent variable models with ordinal categorical covariates , 2012, Stat. Comput..

[12]  Aki Vehtari,et al.  Understanding predictive information criteria for Bayesian models , 2013, Statistics and Computing.

[13]  S Y Lee,et al.  Bayesian estimation and test for factor analysis model with continuous and polytomous data in several populations. , 2001, The British journal of mathematical and statistical psychology.

[14]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[15]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xiangnan Feng,et al.  Latent variable models with nonparametric interaction effects of latent variables , 2014, Statistics in medicine.

[17]  Francis Tuerlinckx,et al.  Detection of Differential Item Functioning Using the Lasso Approach , 2015 .

[18]  Dries F. Benoit,et al.  Bayesian adaptive Lasso quantile regression , 2012 .

[19]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[20]  Edward H. Ip,et al.  A Bayesian Modeling Approach for Generalized Semiparametric Structural Equation Models , 2013, Psychometrika.

[21]  A. Bakker,et al.  Workaholism and well-being among Japanese dual-earner couples: a spillover-crossover perspective. , 2011, Social science & medicine.

[22]  Aki Vehtari,et al.  Efficient implementation of leave-one-out cross-validation and WAIC for evaluating fitted Bayesian models , 2015 .

[23]  Chih-Ling Tsai,et al.  Regression coefficient and autoregressive order shrinkage and selection via the lasso , 2007 .

[24]  G. Casella,et al.  Penalized regression, standard errors, and Bayesian lassos , 2010 .

[25]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[26]  T. Oshio,et al.  Area-Level Income Inequality and Individual Happiness: Evidence from Japan , 2011 .

[27]  H. Ono,et al.  Specialization and Happiness in Marriage: A U.S.-Japan Comparison , 2008, Social science research.

[28]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[29]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[30]  Sik-Yum Lee,et al.  Basic and Advanced Bayesian Structural Equation Modeling: With Applications in the Medical and Behavioral Sciences , 2012 .

[31]  S. Lang,et al.  Bayesian P-Splines , 2004 .

[32]  Xin-Yuan Song,et al.  Bayesian Quantile Structural Equation Models , 2016 .

[33]  H. Zou.  The Adaptive Lasso and Its Oracle Properties , 2006 .

[34]  Valen E Johnson,et al.  Statistical analysis of the National Institutes of Health peer review system , 2008, Proceedings of the National Academy of Sciences.

[35]  M. West.  On scale mixtures of normal distributions , 1987 .

[36]  Chenlei Leng,et al.  Bayesian adaptive Lasso , 2010, Annals of the Institute of Statistical Mathematics.

[37]  B. Muthén.  A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators , 1984 .

[38]  Irini Moustaki,et al.  A general class of latent variable models for ordinal manifest variables with covariate effects on the manifest and latent variables. , 2003, The British journal of mathematical and statistical psychology.

[39]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[40]  Snigdhansu Chatterjee,et al.  Structural Equation Modeling, A Bayesian Approach , 2008, Technometrics.

[41]  Sik-Yum Lee,et al.  Structural equation modelling: A Bayesian approach. , 2007 .

[42]  Madhu S. Mohanty.  Effects of positive attitude on happiness and wage: Evidence from the US data , 2009 .

[43]  E. B. Andersen,et al.  Modern factor analysis , 1961 .

[44]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[45]  M. Sillanpää,et al.  Bayesian mapping of genotype × expression interactions in quantitative and qualitative traits , 2006, Heredity.

[46]  Quasi-Maximum Likelihood Estimation For Latent Variable Models With Mixed Continuous And Polytomous Data , 2005 .

[47]  K. Yuan,et al.  Ridge structural equation modelling with correlation matrices for ordinal and continuous data. , 2011, The British journal of mathematical and statistical psychology.

[48]  Stan Lipovetsky,et al.  Generalized Latent Variable Modeling: Multilevel,Longitudinal, and Structural Equation Models , 2005, Technometrics.

[49]  Valen E. Johnson,et al.  On Bayesian Analysis of Multirater Ordinal Data: An Application to Automated Essay Grading , 1996 .

[50]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.