Estimating the evidence of replicability in "omics" research from follow-up studies

In ”omics” research primary studies are often followed by follow-up studies on promising findings. Informally, reporting the p-values of promising findings in the primary and the follow-up studies gives a sense of the replicability of the findings. We offer a formal statistical approach to measure the evidence of replicability of findings from the primary study to the follow-up study, that exploits the fact that most hypotheses examined in the primary study are null. For each of the findings in the follow-up study we compute the lowest false discovery rate at which the finding is called replicated, which we term the r-value.

[1]  Ruth Heller,et al.  Replicability analysis for genome-wide association studies , 2012, 1209.2829.

[2]  Marina Bogomolov,et al.  Discovering Findings That Replicate From a Primary Study of High Dimension to a Follow-Up Study , 2012, 1207.0187.

[3]  Yu-Cho Woo,et al.  Genome-wide association study identifies a susceptibility locus for thyrotoxic periodic paralysis at 17q24.3 , 2012, Nature Genetics.

[4]  Loki Natarajan,et al.  Exact statistical tests for the intersection of independent lists of genes. , 2012, The annals of applied statistics.

[5]  Wei Wang,et al.  A genome-wide association study in Han Chinese identifies multiple susceptibility loci for IgA nephropathy , 2011, Nature Genetics.

[6]  Peter J. Bickel,et al.  Measuring reproducibility of high-throughput experiments , 2011, 1110.4705.

[7]  Peter Donnelly,et al.  HAPGEN2: simulation of multiple disease SNPs , 2011, Bioinform..

[8]  Yoav Benjamini,et al.  Selective inference in complex research , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[9]  Peter Kraft,et al.  Replication in genome-wide association studies. , 2009, Statistical science : a review journal of the Institute of Mathematical Statistics.

[10]  Roger D Peng,et al.  Reproducible research and Biostatistics. , 2009, Biostatistics.

[11]  Y. Benjamini,et al.  Screening for Partial Conjunction Hypotheses , 2008, Biometrics.

[12]  Judy H. Cho,et al.  Genome-wide association defines more than 30 distinct susceptibility loci for Crohn's disease , 2008, Nature Genetics.

[13]  M. McCarthy,et al.  Genome-wide association studies for complex traits: consensus, uncertainty and challenges , 2008, Nature Reviews Genetics.

[14]  M. McCarthy,et al.  Meta-analysis of genome-wide association data and large-scale replication identifies additional susceptibility loci for type 2 diabetes , 2008, Nature Genetics.

[15]  P. Donnelly,et al.  Replicating genotype–phenotype associations , 2007, Nature.

[16]  John D. Storey.  A direct approach to false discovery rates , 2002 .

[17]  E. Lander,et al.  Genetic dissection of complex traits: guidelines for interpreting and reporting linkage results , 1995, Nature Genetics.

[18]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[19]  S. Young,et al.  p Value Adjustments for Multiple Tests in Multivariate Binomial Models , 1989 .