A Gentle Introduction to Bayesian Hierarchical Linear Regression Models

Considering the flexibility and applicability of Bayesian modeling, in this work we revise the main characteristics of two hierarchical models in a regression setting. We study the full probabilistic structure of the models along with the full conditional distribution for each model parameter. Under our hierarchical extensions, we allow the mean of the second stage of the model to have a linear dependency on a set of covariates. The Gibbs sampling algorithms used to obtain samples when fitting the models are fully described and derived. In addition, we consider a case study in which the plant size is characterized as a function of nitrogen soil concentration and a grouping factor (farm).

[1]  N. G. Best,et al.  The deviance information criterion: 12 years on , 2014 .

[2]  Jim Albert,et al.  Bayesian Computation with R , 2008 .

[3]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[4]  David B. Dunson,et al.  Bayesian data analysis, third edition , 2013 .

[5]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[6]  L. Wasserman,et al.  A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion , 1995 .

[7]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[8]  Peter D. Hoff,et al.  A First Course in Bayesian Statistical Methods , 2009 .

[9]  Sumio Watanabe,et al.  A widely applicable Bayesian information criterion , 2012, J. Mach. Learn. Res..

[10]  Juan Sosa,et al.  Time-varying coefficient model estimation through radial basis functions , 2021, Journal of applied statistics.

[11]  M. Stephens Dealing with label switching in mixture models , 2000 .

[12]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[13]  S. E. Ahmed,et al.  Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference , 2008, Technometrics.

[14]  Aki Vehtari,et al.  Understanding predictive information criteria for Bayesian models , 2013, Statistics and Computing.

[15]  James Cheshire,et al.  A First Course in Bayesian Statistical Methods , 2010 .

[16]  J. Pitman,et al.  The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator , 1997 .

[17]  Sumio Watanabe,et al.  Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory , 2010, J. Mach. Learn. Res..

[18]  Fernando A. Quintana,et al.  Bayesian Nonparametric Data Analysis , 2015 .

[19]  P. Green,et al.  Bayesian Model-Based Clustering Procedures , 2007 .

[20]  Rolando De la Cruz Bayesian ideas and data analysis: An introduction for scientists and statisticians , 2012 .

[21]  H. Ishwaran,et al.  Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models , 2000 .

[22]  Ronald Christensen,et al.  Bayesian Ideas and Data Analysis: An Introduction for Scientists and Statisticians , 2010 .