Evaluation of qPCR curve analysis methods for reliable biomarker discovery: bias, resolution, precision, and implications.

RNA transcripts such as mRNA or microRNA are frequently used as biomarkers to determine disease state or response to therapy. Reverse transcription (RT) in combination with quantitative PCR (qPCR) has become the method of choice to quantify small amounts of such RNA molecules. In parallel with the democratization of RT-qPCR and its increasing use in biomedical research or biomarker discovery, we witnessed a growth in the number of gene expression data analysis methods. Most of these methods are based on the principle that the position of the amplification curve with respect to the cycle-axis is a measure for the initial target quantity: the later the curve, the lower the target quantity. However, most methods differ in the mathematical algorithms used to determine this position, as well as in the way the efficiency of the PCR reaction (the fold increase of product per cycle) is determined and applied in the calculations. Moreover, there is dispute about whether the PCR efficiency is constant or continuously decreasing. Together this has lead to the development of different methods to analyze amplification curves. In published comparisons of these methods, available algorithms were typically applied in a restricted or outdated way, which does not do them justice. Therefore, we aimed at development of a framework for robust and unbiased assessment of curve analysis performance whereby various publicly available curve analysis methods were thoroughly compared using a previously published large clinical data set (Vermeulen et al., 2009) [11]. The original developers of these methods applied their algorithms and are co-author on this study. We assessed the curve analysis methods' impact on transcriptional biomarker identification in terms of expression level, statistical significance, and patient-classification accuracy. The concentration series per gene, together with data sets from unpublished technical performance experiments, were analyzed in order to assess the algorithms' precision, bias, and resolution. While large differences exist between methods when considering the technical performance experiments, most methods perform relatively well on the biomarker data. The data and the analysis results per method are made available to serve as benchmark for further development and evaluation of qPCR curve analysis methods (http://qPCRDataMethods.hfrc.nl).

[1]  I. Cree,et al.  Identification of markers of prostate cancer progression using candidate gene expression , 2011, British Journal of Cancer.

[2]  R. Rutledge,et al.  Mathematics of quantitative kinetic PCR and the application of standard curves. , 2003, Nucleic acids research.

[3]  Thomas D. Schmittgen,et al.  Analysis of relative gene expression data using real-time quantitative PCR and the 2(-Delta Delta C(T)) Method. , 2001, Methods.

[4]  Sheng Zhao,et al.  Comprehensive Algorithm for Quantitative Real-Time Polymerase Chain Reaction , 2005, J. Comput. Biol..

[5]  Russell Higuchi,et al.  Kinetic PCR Analysis: Real-time Monitoring of DNA Amplification Reactions , 1993, Bio/Technology.

[6]  F. Speleman,et al.  Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes , 2002, Genome Biology.

[7]  Christian Mazza,et al.  Statistical significance of quantitative PCR , 2007, BMC Bioinformatics.

[8]  Remo Guidieri.  Res , 1995, RES: Anthropology and Aesthetics.

[9]  A. Tijsen,et al.  Circulating microRNAs: novel biomarkers and extracellular communicators in cardiovascular disease? , 2012, Circulation research.

[10]  Andreas Krause,et al.  A standard curve based method for relative real time PCR data processing , 2005, BMC Bioinformatics.

[11]  Ruth Ladenstein,et al.  Predicting outcomes for children with neuroblastoma using a multigene-expression signature: a retrospective SIOPEN/COG/GPOH study. , 2009, The Lancet. Oncology.

[12]  Weihong Liu,et al.  A new quantitative method of real time reverse transcription polymerase chain reaction assay based on simulation of polymerase chain reaction kinetics. , 2002, Analytical biochemistry.

[13]  A. Loundou,et al.  Clinical variations modulate patterns of gene expression and define blood biomarkers in major depression. , 2010, Journal of psychiatric research.

[14]  Nigel J. Walker,et al.  A Technique Whose Time Has Come , 2002, Science.

[15]  G. Mortier,et al.  qBase relative quantification framework and software for management and automated analysis of real-time quantitative PCR data , 2007, Genome Biology.

[16]  D. Ginzinger.  Gene quantification using real-time quantitative PCR: an emerging technology hits the mainstream. , 2002, Experimental hematology.

[17]  David J. Groggel,et al.  Practical Nonparametric Statistics , 2000, Technometrics.

[18]  G Stolovitzky,et al.  Efficiency of DNA replication in the polymerase chain reaction. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[19]  S. Walker,et al.  Quantitative RT-PCR : Pitfalls and Potential , 1999 .

[20]  M. Pfaffl,et al.  Validities of mRNA quantification using recombinant RNA and recombinant DNA external calibration curves in real-time RT-PCR , 2001, Biotechnology Letters.

[21]  M. Pfaffl,et al.  Comparison of relative mRNA quantification models and the impact of RNA integrity in quantitative real-time RT-PCR , 2006, Biotechnology Letters.

[22]  P. Kirkland,et al.  Comparison of three diagnostic techniques for detection of rotavirus and coronavirus in calf faeces in Australia , 2012, Australian veterinary journal.

[23]  Tania Nolan,et al.  Quantification of mRNA using real-time RT-PCR , 2006, Nature Protocols.

[24]  Russell G Foster,et al.  Experimental validation of novel and conventional approaches to quantitative real-time PCR data analysis. , 2003, Nucleic acids research.

[25]  A. Moorman,et al.  Assumption-free analysis of quantitative real-time polymerase chain reaction (PCR) data , 2003, Neuroscience Letters.

[26]  Robert G. Rutledge,et al.  A Java Program for LRE-Based Real-Time qPCR that Enables Large-Scale Absolute Quantification , 2011, PloS one.

[27]  S. Van Aelst,et al.  Enhanced analysis of real-time PCR data by using a variable efficiency model: FPK-PCR , 2011, Nucleic Acids Research.

[28]  A. Moorman,et al.  Amplification efficiency: linking baseline and bias in the analysis of quantitative PCR data , 2009, Nucleic acids research.

[29]  A. Naranjo,et al.  miRNA Expression Profiling Enables Risk Stratification in Archived and Fresh Neuroblastoma Tumor Samples , 2011, Clinical Cancer Research.

[30]  F. Speleman,et al.  Measurable impact of RNA quality on gene expression results from quantitative PCR , 2011, Nucleic acids research.

[31]  Don Stewart,et al.  Assessing the Performance Capabilities of LRE-Based Assays for Absolute Quantitative Real-Time PCR , 2010, PloS one.

[32]  S A Bustin,et al.  Quantitative real-time RT-PCR--a perspective. , 2005, Journal of molecular endocrinology.

[33]  Peter J. Woolf,et al.  A Mechanistic Model of PCR for Accurate Quantification of Quantitative PCR Data , 2010, PloS one.

[34]  C. Stephan,et al.  miRNAs can predict prostate cancer biochemical relapse and are involved in tumor progression. , 2011, International journal of oncology.

[35]  M. Pfaffl,et al.  Standardized determination of real-time PCR efficiency from a single reaction set-up. , 2003, Nucleic acids research.

[36]  Christian Ritz,et al.  Highly accurate sigmoidal fitting of real-time PCR data by introducing a parameter for asymmetry , 2008, BMC Bioinformatics.

[37]  Michele Guescini,et al.  METHODOLOGY ARTICLE Open Access Methodology article Shape based kinetic outlier detection in real-time , 2022 .

[38]  J. Peccoud,et al.  Theoretical uncertainty of measurements using quantitative polymerase chain reaction. , 1996, Biophysical journal.

[39]  H. D. Vanguilder,et al.  Twenty-five years of quantitative PCR for gene expression analysis. , 2008, BioTechniques.

[40]  J. D. den Dunnen,et al.  High throughput nano-liter RT-qPCR to classify soil contamination using a soil arthropod , 2011, BMC Molecular Biology.

[41]  Perry D Moerland,et al.  MiR423-5p As a Circulating Biomarker for Heart Failure , 2010, Circulation research.

[42]  N. Mcbrien,et al.  High-resolution semi-quantitative real-time PCR without the use of a standard curve. , 2001, BioTechniques.

[43]  Michele Guescini,et al.  A new real-time PCR method to overcome significant quantitative inaccuracy due to slight amplification inhibition , 2008, BMC Bioinformatics.

[44]  Michael Zuker,et al.  UNAFold: software for nucleic acid folding and hybridization. , 2008, Methods in molecular biology.

[45]  V. Beneš,et al.  The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. , 2009, Clinical chemistry.

[46]  R. Kitchen,et al.  Design and optimization of reverse-transcription quantitative PCR experiments. , 2009, Clinical chemistry.

[47]  Mariano J. Alvarez,et al.  Model based analysis of real-time PCR data from DNA binding dye protocols , 2007, BMC Bioinformatics.

[48]  Weihong Liu,et al.  Validation of a quantitative method for real time PCR kinetics. , 2002, Biochemical and biophysical research communications.