CuBlock: a cross-platform normalization method for gene-expression microarrays

Abstract Motivation Cross-(multi)platform normalization of gene-expression microarray data remains an unresolved issue. Despite the existence of several algorithms, they are either constrained by the need to normalize all samples of all platforms together, compromising scalability and reuse, by adherence to the platforms of a specific provider, or simply by poor performance. In addition, many of the methods presented in the literature have not been specifically tested against multi-platform data and/or other methods applicable in this context. Thus, we set out to develop a normalization algorithm appropriate for gene-expression studies based on multiple, potentially large microarray sets collected along multiple platforms and at different times, applicable in systematic studies aimed at extracting knowledge from the wealth of microarray data available in public repositories; for example, for the extraction of Real-World Data to complement data from Randomized Controlled Trials. Our main focus or criterion for performance was on the capacity of the algorithm to properly separate samples from different biological groups. Results We present CuBlock, an algorithm addressing this objective, together with a strategy to validate cross-platform normalization methods. To validate the algorithm and benchmark it against existing methods, we used two distinct datasets, one specifically generated for testing and standardization purposes and one from an actual experimental study. Using these datasets, we benchmarked CuBlock against ComBat (Johnson et al., 2007), UPC (Piccolo et al., 2013), YuGene (Lê Cao et al., 2014), DBNorm (Meng et al., 2017), Shambhala (Borisov et al., 2019) and a simple log2 transform as reference. We note that many other popular normalization methods are not applicable in this context. CuBlock was the only algorithm in this group that could always and clearly differentiate the underlying biological groups after mixing the data, from up to six different platforms in this study. Availability and implementation CuBlock can be downloaded from https://www.mathworks.com/matlabcentral/fileexchange/77882-cublock. Supplementary information Supplementary data are available at Bioinformatics online.

[1]  Pingzhao Hu,et al.  Microarray Meta-Analysis and Cross-Platform Normalization: Integrative Genomics for Robust Biomarker Discovery , 2015, Microarrays.

[2]  Robert M. Califf,et al.  Accelerating development of scientific evidence for medical products within the existing US regulatory framework , 2017, Nature Reviews Drug Discovery.

[3]  Emmanuel Barillot,et al.  Polo-like kinase 1: a potential therapeutic option in combination with conventional chemotherapy for the management of patients with triple-negative breast cancer. , 2013, Cancer research.

[4]  David P. Kreil,et al.  A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control consortium , 2014, Nature Biotechnology.

[5]  Stephen R. Piccolo,et al.  A single-sample microarray normalization method to facilitate personalized-medicine workflows. , 2012, Genomics.

[6]  P. Rousseeuw.  Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[7]  Hidetoshi Shimodaira,et al.  Pvclust: an R package for assessing the uncertainty in hierarchical clustering , 2006, Bioinform..

[8]  M. Gerstein,et al.  The Transcriptional Landscape of the Yeast Genome Defined by RNA Sequencing , 2008, Science.

[9]  David Madigan,et al.  Good practices for real‐world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR‐ISPE Special Task Force on real‐world evidence in health care decision making , 2017, Pharmacoepidemiology and drug safety.

[10]  Rafael A Irizarry,et al.  Exploration, normalization, and summaries of high density oligonucleotide array probe level data. , 2003, Biostatistics.

[11]  C. Wells,et al.  YuGene: a simple approach to scale gene expression data derived from different platforms for integrated analyses. , 2014, Genomics.

[12]  Sabri Boughorbel,et al.  Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric , 2017, PloS one.

[13]  Roger E Bumgarner.  Overview of DNA microarrays: types, applications, and their future. , 2013, Current protocols in molecular biology.

[14]  Wei-Min Liu,et al.  Robust estimators for expression analysis , 2002, Bioinform..

[15]  Emmanuel Barillot,et al.  TTK/hMPS1 Is an Attractive Therapeutic Target for Triple-Negative Breast Cancer , 2013, PloS one.

[16]  Stephen A Krawetz,et al.  Success and failure in human spermatogenesis as revealed by teratozoospermic RNAs. , 2007, Human molecular genetics.

[17]  Patrick Ryan,et al.  Feasibility of Using Real-World Data to Replicate Clinical Trial Evidence , 2019, JAMA network open.

[18]  Nicolas Borisov,et al.  Shambhala: a platform-agnostic data harmonizer for gene expression data , 2019, BMC Bioinformatics.

[19]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[20]  Guillem Rigaill,et al.  Transcriptome Analysis of Wnt3a-Treated Triple-Negative Breast Cancer Cells , 2015, PloS one.

[21]  Hanlee P. Ji,et al.  The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. , 2006, Nature biotechnology.

[22]  C. Mason,et al.  Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data , 2013, Genome Biology.

[23]  David B. Skillicorn,et al.  DBNorm: normalizing high-density oligonucleotide microarray data based on distributions , 2017, BMC Bioinformatics.

[24]  Joel S. Parker,et al.  Adjustment of systematic microarray data biases , 2004, Bioinform..

[25]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[26]  John D. Storey.  A direct approach to false discovery rates , 2002 .

[27]  Stephen R. Piccolo,et al.  Multiplatform single-sample estimates of transcriptional activation , 2013, Proceedings of the National Academy of Sciences.

[28]  Andrew B. Nobel,et al.  Merging two gene-expression studies via cross-platform normalization , 2008, Bioinform..

[29]  P. Brown,et al.  Yeast microarrays for genome wide parallel genetic and gene expression analysis. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Ronald W. Davis,et al.  Quantitative Monitoring of Gene Expression Patterns with a Complementary DNA Microarray , 1995, Science.

[31]  Hidetoshi Shimodaira,et al.  Approximately unbiased tests of regions using multistep-multiscale bootstrap resampling , 2004, math/0508602.

[32]  Faramarz Valafar,et al.  Empirical comparison of cross-platform normalization methods for gene expression data , 2011, BMC Bioinformatics.

[33]  S. Dudoit,et al.  Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. , 2002, Nucleic acids research.

[34]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[35]  Cheng Li,et al.  Adjusting batch effects in microarray expression data using empirical Bayes methods. , 2007, Biostatistics.

[36]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[37]  Octavio Caba,et al.  Integrative multi-platform meta-analysis of gene expression profiles in pancreatic ductal adenocarcinoma patients for identifying novel diagnostic biomarkers , 2017, PloS one.

[38]  Xing Qiu,et al.  MatchMixeR: a cross-platform normalization method for gene expression data integration , 2020, Bioinform..