Statistical properties of an early stopping rule for resampling-based multiple testing.

Resampling-based methods for multiple hypothesis testing often lead to long run times when the number of tests is large. This paper presents a simple rule that substantially reduces computation by allowing resampling to terminate early on a subset of tests. We prove that the method has a low probability of obtaining a set of rejected hypotheses different from those rejected without early stopping, and obtain error bounds for multiple hypothesis testing. Simulation shows that our approach saves more computation than other available procedures.

[1]  Dan-Yu Lin,et al.  A general framework for detecting disease associations with rare variants in sequencing studies. , 2011, American journal of human genetics.

[2]  Nancy R. Zhang,et al.  Detecting simultaneous variant intervals in aligned sequences , 2011, 1108.3177.

[3]  Hui Jiang,et al.  Statistical Modeling of RNA-Seq Data. , 2011, Statistical science : a review journal of the Institute of Mathematical Statistics.

[4]  Cory Y. McLean,et al.  GREAT improves functional interpretation of cis-regulatory regions , 2010, Nature Biotechnology.

[5]  John D. Storey.  A direct approach to false discovery rates , 2002 .

[6]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[7]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[8]  J. MacKinnon,et al.  Bootstrap tests: how many bootstraps? , 2000 .

[9]  D. Rom.  A sequentially rejective test procedure based on a modified Bonferroni inequality , 1990 .

[10]  G. Hommel.  A stagewise rejective multiple test procedure based on a modified Bonferroni test , 1988 .

[11]  B. Efron.  Better Bootstrap Confidence Intervals , 1987 .

[12]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[13]  P. Hall.  On the Number of Bootstrap Simulations Required to Construct a Confidence Interval , 1986 .

[14]  D. Freedman,et al.  Some Asymptotic Theory for the Bootstrap , 1981 .

[15]  Wenge Guo,et al.  Adaptive Choice of the Number of Bootstrap Samples in Large Scale Multiple Testing , 2008, Statistical applications in genetics and molecular biology.

[16]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[17]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[18]  A Sharper Bonferroni Procedure for Multiple Tests of Significance , 2022 .