Exact statistical tests for the intersection of independent lists of genes.

Public data repositories have enabled researchers to compare results across multiple genomic studies in order to replicate findings. A common approach is to first rank genes according to an hypothesis of interest within each study. Then, lists of the top-ranked genes within each study are compared across studies. Genes recaptured as highly ranked (usually above some threshold) in multiple studies are considered to be significant. However, this comparison strategy often remains informal, in that Type I error and false discovery rate are usually uncontrolled. In this paper, we formalize an inferential strategy for this kind of list-intersection discovery test. We show how to compute a p-value associated with a `recaptured' set of genes, using a closed-form Poisson approximation to the distribution of the size of the recaptured set. The distribution of the test statistic depends on the rank threshold and the number of studies within which a gene must be recaptured. We use a Poisson approximation to investigate operating characteristics of the test. We give practical guidance on how to design a bioinformatic list-intersection study with prespecified control of Type I error (at the set level) and false discovery rate (at the gene level). We show how choice of test parameters will affect the expected proportion of significant genes identified. We present a strategy for identifying optimal choice of parameters, depending on the particular alternative hypothesis which might hold. We illustrate our methods using prostate cancer gene-expression datasets from the curated Oncomine database.

[1]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[2]  B. Efron Correlated z-Values and the Accuracy of Large-Scale Statistical Estimates , 2010, Journal of the American Statistical Association.

[3]  Fred A. Wright,et al.  which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Discovering collectively informative descriptors from high-throughput experiments , 2009 .

[4]  S. Dhanasekaran,et al.  The FASEB Journal express article 10.1096/fj.04-2415fje. Published online November 17, 2004. , 2022 .

[5]  Wenguang Sun,et al.  Large‐scale multiple testing under dependence , 2009 .

[6]  Ramesh C. Gupta,et al.  A generalized correlated binomial distribution with application in multiple testing problems , 2008 .

[7]  Charles Wang,et al.  Improving the power for detecting overlapping genes from multiple DNA microarray-derived gene lists , 2008, BMC Bioinformatics.

[8]  T. Barrette,et al.  Oncomine 3.0: genes, pathways, and networks in a collection of 18,000 cancer gene expression profiles. , 2007, Neoplasia.

[9]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[10]  Xin Lu,et al.  RDCurve: A Nonparametric Method to Evaluate the Stability of Ranking Procedures , 2010, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[11]  John Quackenbush,et al.  Multiple-laboratory comparison of microarray platforms , 2005, Nature Methods.

[12]  Steven Skiena,et al.  Meta-analysis based on control of false discovery rate: combining yeast ChIP-chip datasets , 2006, Bioinform..

[13]  Elizabeth Garrett-Mayer,et al.  Cross-study validation and combined analysis of gene expression microarray data. , 2007, Biostatistics.

[14]  John T. Wei,et al.  Integrative molecular concept modeling of prostate cancer progression , 2007, Nature Genetics.

[15]  Y. Benjamini,et al.  Screening for Partial Conjunction Hypotheses , 2008, Biometrics.