Testing Significance in Bayesian Classifiers

The Fully Bayesian Significance Test (FBST) is a coherent Bayesian significance test for sharp hypotheses. This paper explores the FBST as a model selection tool for general mixture models, and gives some computational experiments for Multinomial-Dirichlet-Normal-Wishart models.

[1]  Julio Michael Stern,et al.  Bayesian evidence test for precise hypotheses , 2003 .

[2]  Anthony C. Atkinson,et al.  A Method for Discriminating between Models , 1970 .

[3]  Julio Michael Stern,et al.  Evidence and Credibility: Full Bayesian Significance Test for Precise Hypotheses , 1999, Entropy.

[4]  J. M. Martínez.  BOX-QUACAN and the implementation of Augmented Lagrangian algorithms for minimization with inequalit , 1998 .

[5]  M. Degroot.  Optimal Statistical Decisions , 1970 .

[6]  Charles H. Bennett,et al.  Efficient estimation of free energy differences from Monte Carlo data , 1976 .

[7]  G. Celeux,et al.  Stochastic versions of the em algorithm: an experimental study in the mixture case , 1996 .

[8]  Xiao-Li Meng,et al.  SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION , 1996 .

[9]  Volker Tresp,et al.  Improved Gaussian Mixture Density Estimates Using Bayesian Penalty Terms and Network Averaging , 1995, NIPS.

[10]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[11]  Carlos Alberto de Bragança Pereira,et al.  Model selection: Full Bayesian approach , 2001 .

[12]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[13]  Julio Michael Stern.  Paraconsistent Sensitivity Analysis for Bayesian Significance Tests , 2004, SBIA.

[14]  Olle Häggström.  Finite Markov Chains and Algorithmic Applications , 2002 .

[15]  Julio Michael Stern.  Simulated Annealing with a Temperature Dependent Penalty Function , 1992, INFORMS J. Comput..

[16]  A Orman,et al.  Optimization of Stochastic Models: The Interface Between Simulation and Optimization , 2012, J. Oper. Res. Soc..

[17]  J. Sterna,et al.  Testing the independence of Poisson variates under the Holgate bivariate distribution : the power of a new evidence test , 2002 .

[18]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[19]  Luís Gustavo Esteves,et al.  On the bayesianity of pereira-stern tests , 2001 .

[20]  M. C. Jones.  Generating inverse wishart matrices , 1985 .

[21]  Julio Michael Stern.  Significance Tests, Belief Calculi, and Burden of Proof in Legal and Scientific Discourse , 2002 .

[22]  G. Govaert,et al.  Choosing models in model-based clustering and discriminant analysis , 1999 .

[23]  C. Robert.  Mixtures of Distributions: Inference and Estimation , 1996 .

[24]  Julio Michael Stern.  Uninformative Reference Sensitivity in Possibilistic Sharp Hypotheses Tests , 2004 .

[25]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[26]  P. Saama.  MAXIMUM LIKELIHOOD AND BAYESIAN METHODS FOR MIXTURES OF NORMAL DISTRIBUTIONS , 1997 .