The Use of SSMD-Based False Discovery and False Nondiscovery Rates in Genome-Scale RNAi Screens

In genome-scale RNA interference (RNAi) screens, it is critical to control false positives and false negatives statistically. Traditional statistical methods for controlling false discovery and false nondiscovery rates are inappropriate for hit selection in RNAi screens because the major goal in RNAi screens is to control both the proportion of short interfering RNAs (siRNAs) with a small effect among selected hits and the proportion of siRNAs with a large effect among declared nonhits. An effective method based on strictly standardized mean difference (SSMD) has been proposed for statistically controlling false discovery rate (FDR) and false nondiscovery rate (FNDR) appropriate for RNAi screens. In this article, the authors explore the utility of the SSMD-based method for hit selection in RNAi screens. As demonstrated in 2 genome-scale RNAi screens, the SSMD-based method addresses the unmet need of controlling for the proportion of siRNAs with a small effect among selected hits, as well as controlling for the proportion of siRNAs with a large effect among declared nonhits. Furthermore, the SSMD-based method results in reasonably low FDR and FNDR for selecting inhibition or activation hits. This method works effectively and should have a broad utility for hit selection in RNAi screens with replicates.

[1]  Robin S. Dothager,et al.  Vascular Endothelial Growth Factor Receptor-1 Is Synthetic Lethal to Aberrant β-Catenin Activation in Colon Cancer , 2009, Clinical Cancer Research.

[2]  Xiaohua Douglas Zhang,et al.  A New Method with Flexible and Balanced Control of False Negatives and False Positives for Hit Selection in RNA Interference High-Throughput Screening Assays , 2007, Journal of biomolecular screening.

[3]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[4]  Ji-Hu Zhang,et al.  Probing the Primary Screening Efficiency by Multiple Replicate Testing: A Quantitative Analysis of Hit Confirmation and False Screening Results of a Biochemical Assay , 2005, Journal of biomolecular screening.

[5]  Peter R. McDonald,et al.  Designing, optimizing, and implementing high-throughput siRNA genomic screening with glioma cells for the discovery of survival genes and novel drug targets , 2010, Journal of Neuroscience Methods.

[6]  Wolfgang Huber,et al.  Analysis of cell-based RNAi screens , 2006, Genome Biology.

[7]  P. Kassner,et al.  Discovery of novel targets with high throughput RNA interference screening. , 2008, Combinatorial chemistry & high throughput screening.

[8]  A. Hirsch,et al.  The use of RNAi-based screens to identify host proteins involved in viral replication. , 2010, Future microbiology.

[9]  P. Kassner,et al.  RNA interference screening for the discovery of oncology targets , 2009, Expert opinion on therapeutic targets.

[10]  Xiaohua Douglas Zhang,et al.  Inhibition of Calcineurin-mediated Endocytosis and α-Amino-3-hydroxy-5-methyl-4-isoxazolepropionic Acid (AMPA) Receptors Prevents Amyloid β Oligomer-induced Synaptic Disruption , 2009, The Journal of Biological Chemistry.

[11]  Korbinian Strimmer,et al.  A unified approach to false discovery rate estimation , 2008, BMC Bioinformatics.

[12]  John D. Storey,et al.  Statistical significance for genomewide studies , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Amy S. Espeseth,et al.  Genome-scale RNAi screen for host factors required for HIV replication. , 2008, Cell host & microbe.

[14]  Xiaohua Douglas Zhang,et al.  An Effective Method for Controlling False Discovery and False Nondiscovery Rates in Genome-Scale RNAi Screens , 2010, Journal of biomolecular screening.

[15]  Jing Zhang,et al.  Single cell cytometry of protein function in RNAi treated cells and in native populations , 2007 .

[16]  Xiaohua Douglas Zhang,et al.  A method for effectively comparing gene effects in multiple conditions in RNAi and expression-profiling research. , 2009, Pharmacogenomics.

[17]  C. Conrad,et al.  Automated microscopy for high-content RNAi screening , 2010, The Journal of cell biology.

[18]  Xiaohua Douglas Zhang,et al.  A Lentivirus-Mediated Genetic Screen Identifies Dihydrofolate Reductase (DHFR) as a Modulator of β-Catenin/GSK3 Signaling , 2009, PloS one.

[19]  Anthony J. Muslin,et al.  An Unbiased Chemical Biology Screen Identifies Agents That Modulate Uptake of Oxidized LDL by Macrophages , 2009, Circulation research.

[20]  Aideen Long,et al.  Statistical methods for analysis of high-throughput RNA interference screens , 2009, Nature Methods.

[21]  Xiaohua Douglas Zhang.  Strictly Standardized Mean Difference, Standardized Mean Difference and Classical t-test for the Comparison of Two Groups , 2010 .

[22]  Xiaohua Douglas Zhang,et al.  Determination of sample size in genome-scale RNAi screens , 2009, Bioinform..

[23]  Noel Southall,et al.  COPI Complex Is a Regulator of Lipid Homeostasis , 2008, PLoS biology.

[24]  S. Diamond,et al.  RNA interference screen to identify pathways that enhance or reduce nonviral gene transfer during lipofection. , 2008, Molecular therapy : the journal of the American Society of Gene Therapy.

[25]  Dongmei Liu,et al.  Quantitative assessment of hit detection and confirmation in single and duplicate high-throughput screenings. , 2008, Journal of biomolecular screening.

[26]  Kuan-Teh Jeang,et al.  A Genome-wide Short Hairpin RNA Screening of Jurkat T-cells for Human Proteins Contributing to Productive HIV-1 Replication* , 2009, The Journal of Biological Chemistry.

[27]  Min Xu,et al.  A genome wide analysis of ubiquitin ligases in APP processing identifies a novel regulator of BACE1 mRNA levels , 2006, Molecular and Cellular Neuroscience.