The Bayesian Two-Sample t Test

This article shows how the pooled-variance two-sample t statistic arises from a Bayesian formulation of the two-sided point null testing problem, with emphasis on teaching. We identify a reasonable and useful prior giving a closed-form Bayes factor that can be written in terms of the distribution of the two-sample t statistic under the null and alternative hypotheses, respectively. This provides a Bayesian motivation for the two-sample t statistic, which has heretofore been buried as a special case of more complex linear models, or given only roughly via analytic or Monte Carlo approximations. The resulting formulation of the Bayesian test is easy to apply in practice, and also easy to teach in an introductory course that emphasizes Bayesian methods. The priors are easy to use and simple to elicit, and the posterior probabilities are easily computed using available software, in some cases using spreadsheets.

[1]  L. M. M.-T. Theory of Probability , 1929, Nature.

[2]  D. Lindley A STATISTICAL PARADOX , 1957 .

[3]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[4]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[5]  J. Dickey The Weighted Likelihood Ratio, Linear Hypotheses on Normal Location Parameters , 1971 .

[6]  A. Zellner,et al.  Posterior odds ratios for selected regression hypotheses , 1980 .

[7]  J. Berger,et al.  Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence , 1987 .

[8]  R. Lyle,et al.  Blood pressure and metabolic effects of calcium supplementation in normotensive white and black men. , 1987, JAMA.

[9]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[10]  B. Carlin,et al.  Bayesian Model Choice Via Markov Chain Monte Carlo Methods , 1995 .

[11]  Donald A. Berry,et al.  Statistics: A Bayesian Perspective , 1995 .

[12]  S. Chib Marginal Likelihood from the Gibbs Output , 1995 .

[13]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[14]  T. Louis,et al.  Unified frequentist and Bayesian testing of a precise hypothesis , 1997 .

[15]  Robert E. McCulloch,et al.  Elementary Bayesian Statistics , 1998 .

[16]  W. Johnson,et al.  A Bayesian perspective on the Bonferroni adjustment , 1997 .

[17]  Jim Albert,et al.  Teaching Bayes' Rule: A Data-Oriented Approach , 1997 .

[18]  J. Albert Bayesian Testing and Estimation of Association in a Two-Way Contingency Table , 1997 .

[19]  Donald A. Berry Teaching Elementary Bayesian Statistics with Real Applications in Science , 1997 .

[20]  Marvin Zelen,et al.  Clinical Trials and Sample Size Considerations: Another Perspective , 2000 .

[21]  John D. Storey,et al.  Empirical Bayes Analysis of a Microarray Experiment , 2001 .

[22]  Allan J. Rossman,et al.  Workshop statistics : discovery with data, a Bayesian approach , 2001 .

[23]  K. Koch Introduction to Bayesian Statistics , 2007 .