Evaluation of the External RNA Controls Consortium (ERCC) reference material using a modified Latin square design

BackgroundHighly multiplexed assays for quantitation of RNA transcripts are being used in many areas of biology and medicine. Using data generated by these transcriptomic assays requires measurement assurance with appropriate controls. Methods to prototype and evaluate multiple RNA controls were developed as part of the External RNA Controls Consortium (ERCC) assessment process. These approaches included a modified Latin square design to provide a broad dynamic range of relative abundance with known differences between four complex pools of ERCC RNA transcripts spiked into a human liver total RNA background.ResultsERCC pools were analyzed on four different microarray platforms: Agilent 1- and 2-color, Illumina bead, and NIAID lab-made spotted microarrays; and two different second-generation sequencing platforms: the Life Technologies 5500xl and the Illumina HiSeq 2500. Individual ERCC controls were assessed for reproducible performance in signal response to concentration among the platforms. Most demonstrated linear behavior if they were not located near one of the extremes of the dynamic range. Performance issues with any individual ERCC transcript could be attributed to detection limitations, platform-specific target probe issues, or potential mixing errors. Collectively, these pools of spike-in RNA controls were evaluated for suitability as surrogates for endogenous transcripts to interrogate the performance of the RNA measurement process of each platform. The controls were useful for establishing the dynamic range of the assay, as well as delineating the useable region of that range where differential expression measurements, expressed as ratios, would be expected to be accurate.ConclusionsThe modified Latin square design presented here uses a composite testing scheme for the evaluation of multiple performance characteristics: linear performance of individual controls, signal response within dynamic range pools of controls, and ratio detection between pairs of dynamic range pools. This compact design provides an economical sample format for the evaluation of multiple external RNA controls within a single experiment per platform. These results indicate that well-designed pools of RNA controls, spiked into samples, provide measurement assurance for endogenous gene expression studies.

[1]  Leming Shi,et al.  mRNA enrichment protocols determine the quantification characteristics of external RNA spike-in controls in RNA-Seq studies , 2013, Science China Life Sciences.

[2]  J. L. Sebaugh,et al.  Defining the linear portion of a sigmoid‐shaped curve: bend points , 2003 .

[3]  J. Fellay,et al.  Dynamics of HIV Latency and Reactivation in a Primary CD4+ T Cell Model , 2014, PLoS pathogens.

[4]  G. Grinstein,et al.  Relationship between gene expression and observed intensities in DNA microarrays—a modeling study , 2006, Nucleic acids research.

[5]  Arnaud Buhot,et al.  On the hybridization isotherms of DNA microarrays: the Langmuir model and its extensions , 2006 .

[6]  T. Hashimshony,et al.  CEL-Seq: single-cell RNA-Seq by multiplexed linear amplification. , 2012, Cell reports.

[7]  L. Reid,et al.  Proposed methods for testing and selecting the ERCC external RNA controls , 2005, BMC Genomics.

[8]  I. Yang,et al.  The limits of log-ratios , 2004 .

[9]  David P. Kreil,et al.  Assessing technical performance in differential gene expression experiments with external spike-in RNA control ratio mixtures , 2014, Nature Communications.

[10]  I. Amit,et al.  Massively Parallel Single-Cell RNA-Seq for Marker-Free Decomposition of Tissues into Cell Types , 2014, Science.

[11]  S. Panda,et al.  RNA-Seq Based Transcriptome Analysis of Hepatitis E Virus (HEV) and Hepatitis B Virus (HBV) Replicon Transfected Huh-7 Cells , 2014, PloS one.

[12]  T. Tuschl,et al.  A comprehensive analysis of AID's effects on the transcriptome and methylome of activated B cells , 2013, Nature Immunology.

[13]  P. S. Pine,et al.  An adaptable method using human mixed tissue ratiometric controls for benchmarking performance on gene expression microarrays in clinical laboratories , 2011, BMC biotechnology.

[14]  David M Schruth,et al.  Comparative metatranscriptomics identifies molecular bases for the physiological responses of phytoplankton to varying iron availability , 2012, Proceedings of the National Academy of Sciences.

[15]  David R. Kelley,et al.  Differential gene and transcript expression analysis of RNA-seq experiments with TopHat and Cufflinks , 2012, Nature Protocols.

[16]  Aleksandra A. Kolodziejczyk,et al.  Accounting for technical noise in single-cell RNA-seq experiments , 2013, Nature Methods.

[17]  C. Foy,et al.  Evaluation of Digital PCR for Absolute RNA Quantification , 2013, PloS one.

[18]  B. Williams,et al.  Mapping and quantifying mammalian transcriptomes by RNA-Seq , 2008, Nature Methods.

[19]  Cole Trapnell,et al.  Improving RNA-Seq expression estimates by correcting for fragment bias , 2011, Genome Biology.

[20]  A. Hall,et al.  HIGH EXPRESSION OF OSMOTICALLY RESPONSIVE GENES1 Is Required for Circadian Periodicity through the Promotion of Nucleo-Cytoplasmic mRNA Export in Arabidopsis[W][OPEN] , 2013, Plant Cell.

[21]  M. Salit,et al.  Characterization of in vitro transcription amplification linearity and variability in the low copy number regime using External RNA Control Consortium (ERCC) spike-ins , 2012, Analytical and Bioanalytical Chemistry.

[22]  M. Salit,et al.  Synthetic Spike-in Standards for Rna-seq Experiments Material Supplemental Open Access License Commons Creative , 2022 .

[23]  M. A. Pedraza,et al.  Insights into the Maize Pan-Genome and Pan-Transcriptome[W][OPEN] , 2014, Plant Cell.

[24]  S. Dudoit,et al.  STATISTICAL METHODS FOR IDENTIFYING DIFFERENTIALLY EXPRESSED GENES IN REPLICATED cDNA MICROARRAY EXPERIMENTS , 2002 .

[25]  Fabian J Theis,et al.  Computational analysis of cell-to-cell heterogeneity in single-cell RNA-sequencing data reveals hidden subpopulations of cells , 2015, Nature Biotechnology.

[26]  C. Mason,et al.  A rat RNA-Seq transcriptomic BodyMap across 11 organs and 4 developmental stages , 2014, Nature Communications.

[27]  Ryan K. Dale,et al.  Mediation of Drosophilaautosomal dosage effects and compensation by network interactions , 2012, Genome Biology.

[28]  C. Foy,et al.  RESEARCH ARTICLE Open Access Evaluation of external RNA controls for , 2022 .

[29]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[30]  W. Shi,et al.  The Subread aligner: fast, accurate and scalable read mapping by seed-and-vote , 2013, Nucleic acids research.

[31]  B. McManus,et al.  Variation in RNA-Seq Transcriptome Profiles of Peripheral Whole Blood from Healthy Individuals with and without Globin Depletion , 2014, PloS one.

[32]  Martin S. Taylor,et al.  Application of next generation qPCR and sequencing platforms to mRNA biomarker analysis. , 2013, Methods.

[33]  N. Šestan,et al.  XSAnno: a framework for building ortholog models in cross-species transcriptome comparisons , 2014, BMC Genomics.

[34]  S. P. Fodor,et al.  Molecular indexing enables quantitative targeted RNA sequencing and reveals poor efficiencies in standard library preparations , 2014, Proceedings of the National Academy of Sciences.

[35]  Kathleen F. Kerr,et al.  The External RNA Controls Consortium: a progress report , 2005, Nature Methods.

[36]  John Quackenbush,et al.  Universal RNA reference materials for gene expression. , 2004, Clinical chemistry.

[37]  Paolo Fontana,et al.  Reducing bias in RNA sequencing data: a novel approach to compute counts , 2014, BMC Bioinformatics.

[38]  Charity W. Law,et al.  voom: precision weights unlock linear model analysis tools for RNA-seq read counts , 2014, Genome Biology.

[39]  M. Gearing,et al.  Correction: Corrigendum: Tonic inhibition in dentate gyrus impairs long-term potentiation and memory in an Alzheimer’s disease model , 2014, Nature Communications.

[40]  Marcel E Dinger,et al.  Targeted sequencing for gene discovery and quantification using RNA CaptureSeq , 2014, Nature Protocols.

[41]  A. Oudenaarden,et al.  Validation of noise models for single-cell transcriptomics , 2014, Nature Methods.