Inference functions in high dimensional Bayesian inference

Nonparametric Bayesian models, such as those based on the Dirichlet process or its many variants, provide a flexible class of models that allow us to fit widely varying patterns in data. Typical uses of the models include relatively lowdimensional driving terms to capture global features of the data along with a nonparametric structure to capture local features. The models are particularly good at handling outliers, a common form of local behavior, and examination of the posterior often shows that a portion of the model is chasing the outliers. This suggests the need for robust inference to discount the impact of the outliers on the overall analysis. We advocate the use of inference functions to define relevant parameters that are robust to the deficiencies in the model and illustrate their use in two examples.

[1]  Ju Hee Lee Robust Statistical Modeling through Nonparametric Bayesian Methods , 2010 .

[2]  M. Lavine More Aspects of Polya Tree Distributions for Statistical Modelling , 1992 .

[3]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[4]  P. Lenk The Logistic Normal Distribution for Bayesian, Nonparametric, Predictive Densities , 1988 .

[5]  S. MacEachern,et al.  A semiparametric Bayesian model for randomised block designs , 1996 .

[6]  Abel Rodriguez,et al.  Chapter 3: Dirichlet Process , 2013 .

[7]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[8]  S. Stigler Do Robust Estimators Work with Real Data , 1977 .

[9]  Yiyuan She,et al.  Outlier Detection Using Nonconvex Penalized Regression , 2010, ArXiv.

[10]  Jim E. Griffin,et al.  Default priors for density estimation with mixture models , 2010 .

[11]  Fernando A. Quintana,et al.  Nonparametric Bayesian data analysis , 2004 .

[12]  Peter Müller,et al.  DPpackage: Bayesian Non- and Semi-parametric Modelling in R. , 2011, Journal of statistical software.

[13]  J. Schreiber Foundations Of Statistics , 2016 .

[14]  Michael,et al.  On a Class of Bayesian Nonparametric Estimates : I . Density Estimates , 2008 .

[15]  Stephen M. Stigler,et al.  The History of Statistics: The Measurement of Uncertainty before 1900 , 1986 .

[16]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[17]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[18]  S. MacEachern,et al.  Regularization of Case-Specific Parameters for Robustness and Efficiency , 2012, 1210.0701.

[19]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[20]  Peter Müller,et al.  CENTER-ADJUSTED INFERENCE FOR A NONPARAMETRIC BAYESIAN RANDOM EFFECT DISTRIBUTION. , 2011, Statistica Sinica.

[21]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .