For a list of recent papers see the backpages of this paper. Multilevel

Models with structured additive predictor provide a very broad and rich framework for complex regression modeling. They can deal simultaneously with nonlinear covariate effects and time trends, unit- or cluster-specific heterogeneity, spatial heterogeneity and complex interactions between covariates of different type. In this paper, we propose a hierarchical or multilevel version of regression models with structured additive predictor where the regression coefficients of a particular nonlinear term may obey another regression model with structured additive predictor. In that sense, the model is composed of a hierarchy of complex structured additive regression models. The proposed model may be regarded as an extended version of a multilevel model with nonlinear covariate terms in every level of the hierarchy. The model framework is also the basis for generalized random slope modeling based on multiplicative random effects. Inference is fully Bayesian and based on Markov chain Monte Carlo simulation techniques. We provide an in depth description of several highly efficient sampling schemes that allow to estimate complex models with several hierarchy levels and a large number of observations within a couple of minutes (often even seconds). We demonstrate the practicability of the approach in a complex application on childhood undernutrition with large sample size and three hierarchy levels.

[1]  Peter Wechselberger,et al.  Working Papers in Economics and Statistics Additive Hedonic Regression Models with Spatial Scaling Factors: an Application for Rents in Vienna Additive Hedonic Regression Models with Spatial Scaling Factors: an Application for Rents in Vienna , 2022 .

[2]  Philippe Lambert,et al.  Robust specification of the roughness penalty prior distribution in spatially adaptive Bayesian P-splines models , 2007, Comput. Stat. Data Anal..

[3]  L. Berkman,et al.  Is Economic Growth Associated with Reduction in Child Undernutrition in India? , 2011, PLoS medicine.

[4]  Achim Zeileis,et al.  Extended Beta Regression in R: Shaken, Stirred, Mixed, and Partitioned , 2012 .

[5]  L. Fahrmeir,et al.  Spike-and-Slab Priors for Function Selection in Structured Additive Regression Models , 2011, 1105.5250.

[6]  L. Fahrmeir,et al.  Regression - Modelle, Methoden und Anwendungen , 2009 .

[7]  Robert Kohn,et al.  Variable Selection and Model Averaging in Semiparametric Overdispersed Generalized Linear Models , 2007, 0707.2158.

[8]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[9]  Engelbert Theurl,et al.  Entry and Exit of Physicians in a two-tiered public/private Health Care System , 2011 .

[10]  P. Speckman,et al.  Priors for Bayesian adaptive spline smoothing , 2012 .

[11]  L. Fahrmeir,et al.  Bayesian inference for generalized additive mixed models based on Markov random field priors , 2001 .

[12]  Wolfgang A. Brunauer,et al.  Cost Drivers of Operation Charges and Variation over Time: An Analysis Based on Semiparametric SUR Models , 2010 .

[13]  M. J. Bayarri,et al.  Bayesian Variable Selection for Random Intercept Modeling of Gaussian and non-Gaussian Data , 2010 .

[14]  Graham Thornicroft,et al.  Evidence-Based Guidelines for Mental, Neurological, and Substance Use Disorders in Low- and Middle-Income Countries: Summary of WHO Recommendations , 2011, PLoS medicine.

[15]  L. Fahrmeir,et al.  Geoadditive Survival Models , 2006 .

[16]  Matthias Sutter,et al.  Psychological Pressure in Competitive Environments: Evidence from a Randomized Natural Experiment: Comment , 2010, SSRN Electronic Journal.

[17]  Gottfried Tappeiner,et al.  Multivariate Stochastic Volatility via Wishart Processes - A Continuation , 2011 .

[18]  R. Kohn,et al.  Nonparametric regression using Bayesian variable selection , 1996 .

[19]  Jean-Robert Tyran,et al.  Inequality aversion and voting on redistribution☆ , 2012, European economic review.

[20]  Ludwig Fahrmeir,et al.  Regression: Models, Methods and Applications , 2013 .

[21]  R. Rigby,et al.  Generalized additive models for location, scale and shape , 2005 .

[22]  Christine M. Anderson-Cook,et al.  Generalized Additive Models: An Introduction With R , 2007 .

[23]  Johann Scharler,et al.  For a list of recent papers see the backpages of this paper. Government Size and Business Cycle Volatility; How Important Are Credit Constraints? , 2022 .

[24]  Achim Zeileis,et al.  For a list of recent papers see the backpages of this paper. Structural Breaks in Inflation Dynamics within the European Monetary Union , 2022 .

[25]  R. Kohn,et al.  Locally Adaptive Semiparametric Estimation of the Mean and Variance Functions in Regression Models , 2006 .

[26]  M. Onis,et al.  WHO global database on child growth and malnutrition , 1997 .

[27]  R. Kohn,et al.  A Bayesian approach to nonparametric bivariate regression , 1997 .

[28]  Ludwig Fahrmeir,et al.  Additive mixed models with Dirichlet process mixture and P-spline priors , 2012 .

[29]  Gerda Claeskens,et al.  Simultaneous Confidence Bands for Penalized Spline Estimators , 2009 .

[30]  M. Kirchler,et al.  Thar She Bursts: Reducing Confusion Reduces Bubbles , 2012 .

[31]  C. Holmes,et al.  Bayesian auxiliary variable models for binary and multinomial regression , 2006 .

[32]  Matthias Sutter,et al.  Testing a Forgotten Aspect of Akerlof's Gift Exchange Hypothesis: Relational Contracts with Individual and Uniform Wages , 2012, SSRN Electronic Journal.

[33]  H. Künsch.  Gaussian Markov random fields , 1979 .

[34]  Leonhard Held,et al.  Improved auxiliary mixture sampling for hierarchical models of non-Gaussian data , 2009, Stat. Comput..

[35]  S. Klasen,et al.  Nutrition, health and mortality in sub‐Saharan Africa: Is there a gender bias? , 1996 .

[36]  Andreas Exenberger,et al.  Rain, temperature and agricultural production: The impact of climate change in Sub-Sahara Africa, 1961-2009 , 2011 .

[37]  Stefan Lang,et al.  Working Papers in Economics and Statistics Modeling House Prices Using Multilevel Structured Additive Regression Modeling House Prices Using Multilevel Structured Additive Regression , 2022 .

[38]  Matthias Sutter,et al.  Role Selection and Team Performance , 2011, SSRN Electronic Journal.

[39]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[40]  Matthias Sutter,et al.  The Development of Egalitarianism, Altruism, Spite and Parochialism in Childhood and Adolescence , 2011, SSRN Electronic Journal.

[41]  H. Rue,et al.  Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations , 2009 .

[42]  Achim Zeileis,et al.  Generalized Measurement Invariance Tests with Application to Factor Analysis , 2011 .

[43]  Dani Gamerman,et al.  Space-varying regression models: specifications and simulation , 2001, Comput. Stat. Data Anal..

[44]  Anastasios Panagiotelis,et al.  Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models , 2008 .

[45]  S. Wood.  Thin plate regression splines , 2003 .

[46]  L. Fahrmeir,et al.  PENALIZED STRUCTURED ADDITIVE REGRESSION FOR SPACE-TIME DATA: A BAYESIAN PERSPECTIVE , 2004 .

[47]  Timothy A. Davis,et al.  Direct methods for sparse linear systems , 2006, Fundamentals of algorithms.

[48]  Achim Zeileis,et al.  Structured Additive Regression Models: An R Interface to BayesX , 2015 .

[49]  S. Wood.  Generalized Additive Models: An Introduction with R , 2006 .

[50]  M. Wand,et al.  Semiparametric Regression: Parametric Regression , 2003 .

[51]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[52]  S. Lang,et al.  Bayesian P-Splines , 2004 .

[53]  Matthias Sutter,et al.  Sabotage in Tournaments: Evidence from a Natural Experiment , 2012, SSRN Electronic Journal.

[54]  Achim Zeileis,et al.  Why Does It Always Rain on Me? A Spatio-Temporal Analysis of Precipitation in Austria , 2016 .

[55]  Jeffrey S. Simonoff,et al.  The SAGE Handbook of Multilevel Modeling , 2013 .

[56]  Rupert Sausgruber,et al.  The pivotal mechanism revisited: some evidence on group manipulation , 2013 .

[57]  D. Ruppert.  Selecting the Number of Knots for Penalized Splines , 2002 .

[58]  Gareth O. Roberts,et al.  A General Framework for the Parametrization of Hierarchical Models , 2007, 0708.3797.

[59]  Achim Zeileis,et al.  evtree: Evolutionary Learning of Globally Optimal Classification and Regression Trees in R , 2014 .

[60]  Achim Zeileis,et al.  Flexible Rasch Mixture Models with Package psychomix , 2012 .

[61]  Sylvia Fr.  Data Augmentation and MCMC for Binary and Multinomial Logit Models , 2010 .

[62]  Eric Mayer,et al.  For a list of recent papers see the backpages of this paper. Government Debt, Inflation Dynamics and the Transmission of Fiscal Policy Shocks , 2012 .

[63]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[64]  Glenn Dutcher,et al.  How does the social distance between an employee and a manager affect employee competition for a reward , 2011 .

[65]  Ronald Peeters,et al.  Truth , trust , and sanctions : On institutional selection in sender-receiver games ∗ , 2011 .

[66]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[67]  Achim Zeileis,et al.  A new method for detecting differential item functioning in the Rasch model , 2011 .

[68]  Matthias Sutter,et al.  The Good, the Bad and the Naive: Do Fair Prices Signal Good Types or Do They Induce Good Behaviour? , 2012, SSRN Electronic Journal.

[69]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[70]  S. Frühwirth-Schnatter,et al.  Data Augmentation and MCMC for Binary and Multinomial Logit Models , 2010 .

[71]  Stefan Lang,et al.  Simultaneous selection of variables and smoothing parameters in structured additive regression models , 2008, Comput. Stat. Data Anal..

[72]  Yu Ryan Yue,et al.  For a list of recent papers see the backpages of this paper. Bayesian Semiparametric Additive Quantile Regression , 2022 .

[73]  Rupert Sendlhofer,et al.  Fiscal Policy, Trigger Points and Interest Rates: Additional Evidence From the U.S. , 2011 .

[74]  Martin Larch,et al.  Monetary Policy and its Impact on Stock Market Liquidity: Evidence from the Euro Zone , 2011 .

[75]  Michael Pfaffermayr,et al.  Does Going Green Pay Off? the Effect of an International Environmental Agreement on Tropical Timber Trade Does Going Green Pay off ? the Effect of an International Environmental Agreement on Tropical Timber Trade , 2022 .

[76]  Paul H. C. Eilers,et al.  Flexible smoothing with B-splines and penalties , 1996 .

[77]  Matthias Sutter,et al.  What Drives Taxi Drivers? A Field Experiment on Fraud in a Market for Credence Goods , 2011, SSRN Electronic Journal.

[78]  Andreas Brezger,et al.  Generalized structured additive regression based on Bayesian P-splines , 2006, Comput. Stat. Data Anal..