On the Empirical Bayes approach to the problem of multiple testing

We discuss the Empirical Bayes approach to the problem of multiple testing and compare it with a very popular frequentist method of Benjamini and Hochberg aimed at controlling the false discovery rate. Our main focus is the ‘sparse mixture’ case, when only a small proportion of tested hypotheses is expected to be false. The specific parametric model we consider is motivated by the application to detecting genes responsible for quantitative traits, but it can be used in a variety of other applications. We define some Parametric Empirical Bayes procedures for multiple testing and compare them with the Benjamini and Hochberg method using computer simulations. We explain some similarities between these two approaches by placing them within the same framework of threshold tests with estimated critical values. Copyright © 2007 John Wiley & Sons, Ltd.

[1]  Sylvia Richardson,et al.  Detection of gene copy number changes in CGH microarrays using a spatially correlated mixture model , 2006, Bioinform..

[2]  Nengjun Yi,et al.  A Unified Markov Chain Monte Carlo Framework for Mapping Multiple Quantitative Trait Loci , 2004, Genetics.

[3]  P. Müller,et al.  Optimal Sample Size for Multiple Testing , 2004 .

[4]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[5]  James G. Scott,et al.  An exploration of aspects of Bayesian multiple testing , 2006 .

[6]  Alain Charcosset,et al.  Genetic Architecture of Flowering Time in Maize As Inferred From Quantitative Trait Loci Meta-analysis and Synteny Conservation With the Rice Genome , 2004, Genetics.

[7]  J. Ghosh,et al.  A comparison of the Benjamini-Hochberg procedure with some Bayesian rules for multiple testing , 2008, 0805.2479.

[8]  H Geldermann,et al.  Combined analyses of data from quantitative trait loci mapping studies. Chromosome 4 effects on porcine growth and fatness. , 2000, Genetics.

[9]  B. Efron.  Robbins, Empirical Bayes, And Microarrays , 2001 .

[10]  P. Seeger.  A Note on a Method for the Analysis of Significances en masse , 1968 .

[11]  I. Johnstone,et al.  Adapting to unknown sparsity by controlling the false discovery rate , 2005, math/0505374.

[12]  John D. Storey.  The positive false discovery rate: a Bayesian interpretation and the q-value , 2003 .

[13]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[14]  B. Sorić.  Statistical “Discoveries” and Effect-Size Estimation , 1989 .

[15]  D. Donoho,et al.  Higher criticism for detecting sparse heterogeneous mixtures , 2004, math/0410072.

[16]  L. Wasserman,et al.  Operating characteristics and extensions of the false discovery rate procedure , 2002 .

[17]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[18]  Tatiana Foroud,et al.  Genetic Strategies to Detect Genes Involved in Alcoholism and Alcohol-Related Traits , 2002, Alcohol research & health : the journal of the National Institute on Alcohol Abuse and Alcoholism.

[19]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[20]  R. Tibshirani,et al.  Empirical bayes methods and false discovery rates for microarrays , 2002, Genetic epidemiology.

[21]  S. Leal.  Genetics and Analysis of Quantitative Traits , 2001 .

[22]  Imke Tammen,et al.  Quantitative trait loci mapping in dairy cattle: review and meta-analysis , 2004, Genetics Selection Evolution.

[23]  B. Efron,et al.  Stein's Estimation Rule and Its Competitors- An Empirical Bayes Approach , 1973 .

[24]  Y. Benjamini,et al.  On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics , 2000 .

[25]  John D. Storey,et al.  Empirical Bayes Analysis of a Microarray Experiment , 2001 .