Structured Additive Regression Models: An R Interface to BayesX

Structured additive regression (STAR) models provide a flexible framework for modeling possible nonlinear effects of covariates: They contain the well established frameworks of generalized linear models and generalized additive models as special cases but also allow a wider class of effects, e.g., for geographical or spatio-temporal data, allowing for specification of complex and realistic models. BayesX is standalone software package providing software for fitting general class of STAR models. Based on a comprehensive open-source regression toolbox written in C++, BayesX uses Bayesian inference for estimating STAR models based on Markov chain Monte Carlo simulation techniques, a mixed model representation of STAR models, or stepwise regression techniques combining penalized least squares estimation with model selection. BayesX not only covers models for responses from univariate exponential families, but also models from less-standard regression situations such as models for multi-categorical responses with either ordered or unordered categories, continuous time survival data, or continuous time multi-state models. This paper presents a new fully interactive R interface to BayesX: the R package R2BayesX. With the new package, STAR models can be conveniently specified using R’s formula language (with some extended terms), fitted using the BayesX binary, represented in R with objects of suitable classes, and finally printed/summarized/plotted. This makes BayesX much more accessible to users familiar with R and adds extensive graphics capabilities for visualizing fitted STAR models. Furthermore, R2BayesX complements the already impressive capabilities for semiparametric regression in R by a comprehensive toolbox comprising in particular more complex response types and alternative inferential procedures such as simulation-based Bayesian inference.

[1]  Stanley R. Johnson,et al.  Varying Coefficient Models , 1984 .

[2]  B. Ripley,et al.  Semiparametric Regression: Preface , 2003 .

[3]  Andreas Exenberger,et al.  Rain, temperature and agricultural production: The impact of climate change in Sub-Sahara Africa, 1961-2009 , 2011 .

[4]  Matthias Sutter,et al.  Sabotage in Tournaments: Evidence from a Natural Experiment , 2012, SSRN Electronic Journal.

[5]  Jean-Robert Tyran,et al.  Inequality aversion and voting on redistribution☆ , 2012, European economic review.

[6]  Kurt Hornik,et al.  Escaping RGBland: Selecting colors for statistical graphics , 2009, Comput. Stat. Data Anal..

[7]  R. Rigby,et al.  Generalized additive models for location, scale and shape , 2005 .

[8]  Matthias Sutter,et al.  Role Selection and Team Performance , 2011, SSRN Electronic Journal.

[9]  Eric Mayer,et al.  For a list of recent papers see the backpages of this paper. Government Debt, Inflation Dynamics and the Transmission of Fiscal Policy Shocks , 2012 .

[10]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[11]  R. Tibshirani,et al.  Generalized Additive Models , 1986 .

[12]  Ludwig Fahrmeir,et al.  Regression: Models, Methods and Applications , 2013 .

[13]  Johann Scharler,et al.  For a list of recent papers see the backpages of this paper. Government Size and Business Cycle Volatility; How Important Are Credit Constraints? , 2022 .

[14]  Alan Y. Chiang,et al.  Generalized Additive Models: An Introduction With R , 2007, Technometrics.

[15]  H. Rue,et al.  Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations , 2009 .

[16]  Achim Zeileis,et al.  Generalized Measurement Invariance Tests with Application to Factor Analysis , 2011 .

[17]  L. Fahrmeir,et al.  PENALIZED STRUCTURED ADDITIVE REGRESSION FOR SPACE-TIME DATA: A BAYESIAN PERSPECTIVE , 2004 .

[18]  David R. Anderson,et al.  Model Selection and Multimodel Inference , 2003 .

[19]  Chris Brunsdon,et al.  Geographically Weighted Regression: The Analysis of Spatially Varying Relationships , 2002 .

[20]  Achim Zeileis,et al.  Why Does It Always Rain on Me? A Spatio-Temporal Analysis of Precipitation in Austria , 2016 .

[21]  Achim Zeileis,et al.  R Package Distribution of the BayesX C++ Sources , 2013 .

[22]  Ronald Peeters,et al.  Truth , trust , and sanctions : On institutional selection in sender-receiver games ∗ , 2011 .

[23]  Matthias Sutter,et al.  Psychological Pressure in Competitive Environments: Evidence from a Randomized Natural Experiment: Comment , 2010, SSRN Electronic Journal.

[24]  Gottfried Tappeiner,et al.  Multivariate Stochastic Volatility via Wishart Processes - A Continuation , 2011 .

[25]  Achim Zeileis,et al.  A new method for detecting differential item functioning in the Rasch model , 2011 .

[26]  Matthias Sutter,et al.  The Good, the Bad and the Naive: Do Fair Prices Signal Good Types or Do They Induce Good Behaviour? , 2012, SSRN Electronic Journal.

[27]  Stefan Lang,et al.  Simultaneous selection of variables and smoothing parameters in structured additive regression models , 2008, Comput. Stat. Data Anal..

[28]  Rupert Sausgruber,et al.  The pivotal mechanism revisited: some evidence on group manipulation , 2013 .

[29]  Achim Zeileis,et al.  evtree: Evolutionary Learning of Globally Optimal Classification and Regression Trees in R , 2014 .

[30]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[31]  H. Pruscha,et al.  Der Einfluß von Bestandeskenngrößen, Topographie, Standort und Witterung auf die Entwicklung des Kronenzustandes im Bereich des Forstamtes Rothenbuch , 1996, Forstwissenschaftliches Centralblatt vereinigt mit Tharandter forstliches Jahrbuch.

[32]  Achim Zeileis,et al.  Flexible Rasch Mixture Models with Package psychomix , 2012 .

[33]  T. Yee.  The VGAM Package for Categorical Data Analysis , 2010 .

[34]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[35]  Achim Zeileis,et al.  For a list of recent papers see the backpages of this paper. Structural Breaks in Inflation Dynamics within the European Monetary Union , 2022 .

[36]  Matthias Sutter,et al.  The Development of Egalitarianism, Altruism, Spite and Parochialism in Childhood and Adolescence , 2011, SSRN Electronic Journal.

[37]  Martyn Plummer,et al.  JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling , 2003 .

[38]  Trevor Hastie,et al.  Statistical Models in S , 1991 .

[39]  S. Wood.  Generalized Additive Models: An Introduction with R , 2006 .

[40]  M. Plummer,et al.  CODA: convergence diagnosis and output analysis for MCMC , 2006 .

[41]  Glenn Dutcher,et al.  How does the social distance between an employee and a manager affect employee competition for a reward , 2011 .

[42]  X. Lin,et al.  Inference in generalized additive mixed modelsby using smoothing splines , 1999 .

[43]  Edzer J. Pebesma,et al.  Applied spatial data analysis with R , 2008, Use R!.

[44]  Finn Lindgren,et al.  Bayesian Spatial Modelling with R-INLA , 2015 .

[45]  Michael Pfaffermayr,et al.  Does Going Green Pay Off? the Effect of an International Environmental Agreement on Tropical Timber Trade Does Going Green Pay off ? the Effect of an International Environmental Agreement on Tropical Timber Trade , 2022 .

[46]  Matthias Sutter,et al.  What Drives Taxi Drivers? A Field Experiment on Fraud in a Market for Credence Goods , 2011, SSRN Electronic Journal.

[47]  Andreas Brezger,et al.  Generalized structured additive regression based on Bayesian P-splines , 2006, Comput. Stat. Data Anal..

[48]  C. Wild,et al.  Vector Generalized Additive Models , 1996 .

[49]  E. Pebesma,et al.  Classes and Methods for Spatial Data , 2015 .

[50]  Martin Larch,et al.  Monetary Policy and its Impact on Stock Market Liquidity: Evidence from the Euro Zone , 2011 .

[51]  Andrew Thomas,et al.  The BUGS project: Evolution, critique and future directions , 2009, Statistics in medicine.

[52]  Matthias Sutter,et al.  Testing a Forgotten Aspect of Akerlof's Gift Exchange Hypothesis: Relational Contracts with Individual and Uniform Wages , 2012, SSRN Electronic Journal.

[53]  Yu Ryan Yue,et al.  For a list of recent papers see the backpages of this paper. Bayesian Semiparametric Additive Quantile Regression , 2022 .

[54]  S. Wood.  Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models , 2011 .

[55]  Rupert Sendlhofer,et al.  Fiscal Policy, Trigger Points and Interest Rates: Additional Evidence From the U.S. , 2011 .

[56]  L. Fahrmeir,et al.  Regression - Modelle, Methoden und Anwendungen , 2009 .

[57]  Achim Zeileis,et al.  Extended Beta Regression in R: Shaken, Stirred, Mixed, and Partitioned , 2012 .

[58]  Engelbert Theurl,et al.  Entry and Exit of Physicians in a two-tiered public/private Health Care System , 2011 .

[59]  L. Fahrmeir,et al.  Structured Additive Regression for Categorical Space–Time Data: A Mixed Model Approach , 2006 .

[60]  L. Fahrmeir,et al.  Bayesian inference for generalized additive mixed models based on Markov random field priors , 2001 .

[61]  Guangqing Chi,et al.  Applied Spatial Data Analysis with R , 2015 .

[62]  Stefan Lang,et al.  For a list of recent papers see the backpages of this paper. Multilevel , 2022 .

[63]  Thomas Kneib,et al.  Mixed model based inference in structured additive regression , 2006 .

[64]  Eric R. Ziegel,et al.  Multivariate Statistical Modelling Based on Generalized Linear Models , 2002, Technometrics.

[65]  F. Scheipl.  spikeSlabGAM: Bayesian Variable Selection, Model Choice and Regularization for Generalized Additive Mixed Models in R , 2011, 1105.5253.

[66]  Kurt Hornik,et al.  History Repeating: Spain Beats Germany in the EURO 2012 Final , 2012 .

[67]  Ludwig Fahrmeir,et al.  Structured Additive Regression for Multicategorical Space-Time Data : A Mixed Model Approach , 2004 .

[68]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[69]  R. Rigby,et al.  Generalized Additive Models for Location Scale and Shape (GAMLSS) in R , 2007 .

[70]  T. Kneib,et al.  BayesX: Analyzing Bayesian Structural Additive Regression Models , 2005 .

[71]  Ludwig Fahrmeir,et al.  Semiparametric Analysis of the Socio-Demographic and Spatial Determinants of Undernutrition in Two African Countries , 2001 .

[72]  S. Lang,et al.  Bayesian P-Splines , 2004 .

[73]  M. Kirchler,et al.  Thar She Bursts: Reducing Confusion Reduces Bubbles , 2012 .

[74]  L. Fahrmeir,et al.  Software for Bayesian Inference in Structured Additive Regression Models Methodology Manual Acknowledgements Licensing Agreement Structured Additive Regression Based on Mcmc Simulation , 2022 .