True and false discoveries with e-values

We discuss controlling the number of false discoveries using e-values instead of p-values. Using e-values simplifies the known algorithms radically.

[1]  Jeffrey T Leek,et al.  The optimal discovery procedure for large-scale significance testing, with applications to comparative microarray experiments. , 2007, Biostatistics.

[2]  Vladimir Vovk,et al.  Game‐Theoretic Foundations for Probability and Finance , 2019, Wiley Series in Probability and Statistics.

[3]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[4]  V. Vovk,et al.  Combining e-values and p-values , 2019, SSRN Electronic Journal.

[5]  W. Johnson,et al.  The Bayesian Two-Sample t Test , 2005 .

[6]  Xiao-Li Meng,et al.  Posterior Predictive $p$-Values , 1994 .

[7]  Aldo Solari,et al.  Simultaneous control of all false discovery proportions in large-scale multiple hypothesis testing , 2019, Biometrika.

[8]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[9]  Stochastic Inequalities,et al.  RANDOM VARIABLES WITH MAXIMUM SUMS , 1982 .

[10]  E. Wagenmakers,et al.  Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology , 2016 .

[11]  L. Wasserman,et al.  False discovery control with p-value weighting , 2006 .

[12]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[13]  Michael Wolf,et al.  Control of generalized error rates in multiple testing , 2007, 0710.2258.

[14]  L. Wasserman,et al.  A stochastic process approach to false discovery control , 2004, math/0406519.

[15]  Min Wang,et al.  A Simple Two-Sample Bayesian t-Test for Hypothesis Testing , 2015, 1509.02568.

[16]  W. Johnson,et al.  Comparing Objective and Subjective Bayes Factors for the Two-Sample Comparison: The Classification Theorem in Action , 2019, The American statistician.

[17]  Thijs van Ommen,et al.  Inconsistency of Bayesian Inference for Misspecified Linear Models, and a Proposal for Repairing It , 2014, 1412.3730.

[18]  Abraham Wald,et al.  Statistical Decision Functions , 1951 .

[19]  G. Shafer.  The Language of Betting as a Strategy for Statistical and Scientific Communication , 2019, 1903.06991.

[20]  W. Gasarch,et al.  The Book Review Column 1 Coverage Untyped Systems Simple Types Recursive Types Higher-order Systems General Impression 3 Organization, and Contents of the Book , 2022 .

[21]  Sanat K. Sarkar.  Simes' Test in Multiple Testing , 2011, International Encyclopedia of Statistical Science.

[22]  Daniel J. Wilson,et al.  The harmonic mean p-value for combining dependent tests , 2019, Proceedings of the National Academy of Sciences.

[23]  V. Vovk,et al.  Combining p-values via averaging , 2020, Biometrika.

[24]  M. S. Bartlett,et al.  Statistical methods and scientific inference. , 1957 .

[25]  Michael I. Jordan,et al.  A unified treatment of multiple testing with prior knowledge using the p-filter , 2017, The Annals of Statistics.

[26]  Thomas E. Nichols,et al.  The harmonic mean p-value: Strong versus weak control, and the assumption of independence , 2019, Proceedings of the National Academy of Sciences.

[27]  L. Wasserman,et al.  Exceedance Control of the False Discovery Proportion , 2006 .

[28]  L. M. M.-T..  Theory of Probability , 1929, Nature.

[29]  Wouter M. Koolen,et al.  Safe Testing , 2019, 2020 Information Theory and Applications Workshop (ITA).

[30]  John D. Storey,et al.  Statistical significance for genomewide studies , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  P. Müller,et al.  A Bayesian discovery procedure , 2009, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[32]  L. Held.  On the Bayesian interpretation of the harmonic mean p-value , 2019, Proceedings of the National Academy of Sciences.

[33]  E. Dougherty,et al.  Gene-expression profiles in hereditary breast cancer. , 2001, The New England journal of medicine.

[34]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[35]  Jelle J. Goeman,et al.  Permutation-based simultaneous confidence bounds for the false discovery proportion , 2018, Biometrika.

[36]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[37]  J. Goeman,et al.  Multiple Testing for Exploratory Research , 2011, 1208.2841.