Locally adaptive Bayesian P-splines with a Normal-Exponential-Gamma prior

An implementation of locally adaptive penalized spline smoothing using a class of heavy-tailed shrinkage priors for the estimation of functional forms with highly varying curvature or discontinuities is presented. These priors utilize scale mixtures of normals with locally varying exponential-gamma distributed variances for the differences of the P-spline coefficients. A fully Bayesian hierarchical structure is derived with inference about the posterior being based on Markov Chain Monte Carlo techniques. Three increasingly flexible and automatic approaches are introduced to estimate the spatially varying structure of the variances. An extensive simulation study for Gaussian, Poisson, and Binomial responses shows that the performance of this approach on a number of benchmark functions is competitive to that of previous approaches. Results from applications with Gaussian and Poisson responses support the simulation results.

[1]  J. Griffin,et al.  Alternative prior distributions for variable selection with very many more variables than observations , 2005 .

[2]  Manuel J. A. Eugster,et al.  Bench plot and mixed effects models: first steps toward a comprehensive benchmark analysis toolbox , 2008 .

[3]  Dani Gamerman,et al.  Sampling from the posterior distribution in generalized linear mixed models , 1997, Stat. Comput..

[4]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[5]  Veerabhadran Baladandayuthapani,et al.  Spatially Adaptive Bayesian Penalized Regression Splines (P-splines) , 2005 .

[6]  Manuel J. A. Eugster,et al.  Bench Plot and Mixed Effects Models: First steps toward a comprehensive benchmark analysis toolbox , 2008 .

[7]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[8]  Robert E Kass,et al.  An Implementation of Bayesian Adaptive Regression Splines (BARS) in C with S and R Wrappers. , 2008, Journal of statistical software.

[9]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[10]  Kurt Hornik,et al.  The Design and Analysis of Benchmark Experiments , 2005 .

[11]  David Ruppert,et al.  Theory & Methods: Spatially‐adaptive Penalties for Spline Fitting , 2000 .

[12]  J. Griffin,et al.  Bayesian adaptive lassos with non-convex penalization , 2007 .

[13]  S. Lang,et al.  Bayesian P-Splines , 2004 .

[14]  Philippe Lambert,et al.  Robust specification of the roughness penalty prior distribution in spatially adaptive Bayesian P-splines models , 2007, Comput. Stat. Data Anal..

[15]  R. Kass,et al.  Bayesian curve-fitting with free-knot splines , 2001 .

[16]  C. Biller Adaptive Bayesian Regression Splines in Semiparametric Generalized Linear Models , 2000 .

[17]  Adrian F. M. Smith,et al.  Automatic Bayesian curve fitting , 1998 .

[18]  B. Jørgensen Statistical Properties of the Generalized Inverse Gaussian Distribution , 1981 .

[19]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[20]  Ludwig Fahrmeir,et al.  Function estimation with locally adaptive dynamic models , 2002, Comput. Stat..

[21]  C. Crainiceanu,et al.  Fast Adaptive Penalized Splines , 2008 .

[22]  Volkmar Liebscher,et al.  Specificity assessment from fractionation experiments (SAFE): a novel method to evaluate microarray probe specificity based on hybridisation stringencies. , 2003, Nucleic acids research.

[23]  Paul H. C. Eilers,et al.  Flexible smoothing with B-splines and penalties , 1996 .

[24]  Andreas Brezger,et al.  Generalized structured additive regression based on Bayesian P-splines , 2006, Comput. Stat. Data Anal..

[25]  D. Ruppert,et al.  Spatially Adaptive Bayesian Penalized Splines With Heteroscedastic Errors , 2007 .

[26]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .