Novel Analytic Criteria and Effective Plate Designs for Quality Control in Genome-Scale RNAi Screens

One of the most fundamental challenges in genome-wide RNA interference (RNAi) screens is to glean biological significance from mounds of data, which relies on the development and adoption of appropriate analytic methods and designs for quality control (QC) and hit selection. Currently, a Z-factor-based QC criterion is widely used to evaluate data quality. However, this criterion cannot take into account the fact that different positive controls may have different effect sizes and leads to inconsistent QC results in experiments with 2 or more positive controls with different effect sizes. In this study, based on a recently proposed parameter, strictly standardized mean difference (SSMD), novel QC criteria are constructed for evaluating data quality in genome-wide RNAi screens. Two good features of these novel criteria are: (1) SSMD has both clear original and probability meanings for evaluating the differentiation between positive and negative controls and hence the SSMD-based QC criteria have a solid probabilistic and statistical basis, and (2) these QC criteria obtain consistent QC results for multiple positive controls with different effect sizes. In addition, I propose multiple plate designs and the guidelines for using them in genome-wide RNAi screens. Finally, I provide strategies for using the SSMD-based QC criteria and effective plate design together to improve data quality. The novel SSMD-based QC criteria, effective plate designs, and related guidelines and strategies may greatly help to obtain high quality of data in genome-wide RNAi screens. (Journal of Biomolecular Screening 2008:363-377)

[1]  L. Harlow,et al.  What if there were no significance tests , 1997 .

[2]  Michael Eisenstein,et al.  Microarrays: Quality control , 2006, Nature.

[3]  Shane D. Marine,et al.  LRRTM3 promotes processing of amyloid-precursor protein by BACE1 and is a positional candidate gene for late-onset Alzheimer's disease , 2006, Proceedings of the National Academy of Sciences.

[4]  Yunxia Sui,et al.  Alternative Statistical Parameter for High-Throughput Screening Assay Quality Assessment , 2007, Journal of biomolecular screening.

[5]  A. Fire,et al.  Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans , 1998, Nature.

[6]  Xiaohua Douglas Zhang.  A pair of new statistical parameters for quality control in RNA interference high-throughput screening assays. , 2007, Genomics.

[7]  Wolfgang Huber,et al.  Analysis of cell-based RNAi screens , 2006, Genome Biology.

[8]  J. Dennis,et al.  Chemical enhancers of cytokine signaling that suppress microfilament turnover and tumor cell growth. , 2006, Cancer research.

[9]  Min Xu,et al.  A genome wide analysis of ubiquitin ligases in APP processing identifies a novel regulator of BACE1 mRNA levels , 2006, Molecular and Cellular Neuroscience.

[10]  Mengxiang Tang,et al.  Multiplex mRNA assay using electrophoretic tags for high-throughput gene expression analysis. , 2004, Nucleic acids research.

[11]  Andreas Schwienhorst,et al.  Thrombin inhibitors identified by computer-assisted multiparameter design. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Kim E. Garbison,et al.  The Minimum Significant Ratio: A Statistical Parameter to Characterize the Reproducibility of Potency Estimates from Concentration-Response Assays and Estimation by Replicate-Experiment Studies , 2006, Journal of biomolecular screening.

[13]  Reuven Agami,et al.  A large-scale RNAi screen in human cells identifies new components of the p53 pathway , 2004, Nature.

[14]  M. Manoharan,et al.  RNAi therapeutics: a potential new class of pharmaceutical drugs , 2006, Nature chemical biology.

[15]  Nagesh Mahanthappa,et al.  Translating RNA interference into therapies for human disease. , 2005, Pharmacogenomics.

[16]  Bert Gunter,et al.  Statistical and Graphical Methods for Quality Control Determination of High-Throughput Screening Data , 2003, Journal of biomolecular screening.

[17]  Marc Ferrer,et al.  The Use of Strictly Standardized Mean Difference for Hit Selection in Primary RNA Interference High-Throughput Screening Experiments , 2007, Journal of biomolecular screening.

[18]  Xiaohua Douglas Zhang,et al.  A New Method with Flexible and Balanced Control of False Negatives and False Positives for Hit Selection in RNA Interference High-Throughput Screening Assays , 2007, Journal of biomolecular screening.

[19]  N. Perrimon,et al.  Functional Genomic Analysis of the Wnt-Wingless Signaling Pathway , 2005, Science.

[20]  Thomas D. Y. Chung,et al.  A Simple Statistical Parameter for Use in Evaluation and Validation of High Throughput Screening Assays , 1999, Journal of biomolecular screening.

[21]  Marc Ferrer,et al.  Robust statistical methods for hit selection in RNA interference high-throughput screening experiments. , 2006, Pharmacogenomics.

[22]  N. Perrimon,et al.  Functional genomics reveals genes involved in protein secretion and Golgi organization , 2006, Nature.

[23]  Norbert Perrimon,et al.  Design and implementation of high-throughput RNAi screens in cultured Drosophila cells , 2007, Nature Protocols.

[24]  Shane D. Marine,et al.  High-Throughput Screening by RNA Interference: Control of Two Distinct Types of Variance , 2007, Cell cycle.

[25]  D. H. Besterfield.  Quality control , 1979 .

[26]  Xiaohua Douglas Zhang,et al.  Integrating Experimental and Analytic Approaches to Improve Data Quality in Genome-wide RNAi Screens , 2008, Journal of biomolecular screening.

[27]  Robert Nadon,et al.  Statistical practice in high-throughput screening data analysis , 2006, Nature Biotechnology.

[28]  Bert Gunter,et al.  Improved Statistical Methods for Hit Selection in High-Throughput Screening , 2003, Journal of biomolecular screening.

[29]  James Inglese,et al.  A cell-based β-lactamase reporter gene assay for the identification of inhibitors of hepatitis C virus replication , 2004 .

[30]  Zhenbao Yu,et al.  High-throughput screening of effective siRNAs from RNAi libraries delivered via bacterial invasion , 2005, Nature Methods.

[31]  Gregory J. Hannon,et al.  Small RNAs, big biology: biochemical studies of RNA interference , 2003 .

[32]  Brian J Eastwood,et al.  A Comparison of Assay Performance Measures in Screening Assays: Signal Window, Z' Factor, and Assay Variability Ratio , 2006, Journal of biomolecular screening.