Comparative assessment of differential network analysis methods

Differential network analysis (DiNA) denotes a recent class of network-based Bioinformatics algorithms which focus on the differences in network topologies between two states of a cell, such as healthy and disease, to identify key players in the discriminating biological processes. In contrast to conventional differential analysis, DiNA identifies changes in the interplay between molecules, rather than changes in single molecules. This ability is especially important in cases where effectors are changed, e.g. mutated, but their expression is not. A number of different DiNA approaches have been proposed, yet a comparative assessment of their performance in different settings is still lacking. In this paper, we evaluate 10 different DiNA algorithms regarding their ability to recover genetic key players from transcriptome data. We construct high-quality regulatory networks and enrich them with co-expression data from four different types of cancer. Next, we assess the results of applying DiNA algorithms on these data sets using a gold standard list (GSL). We find that local DiNA algorithms are generally superior to global algorithms, and that all DiNA algorithms outperform conventional differential expression analysis. We also assess the ability of DiNA methods to exploit additional knowledge in the underlying cellular networks. To this end, we enrich the cancer-type specific networks with known regulatory miRNAs and compare the algorithms performance in networks with and without miRNA. We find that including miRNAs consistently and considerably improves the performance of almost all tested algorithms. Our results underline the advantages of comprehensive cell models for the analysis of -omics data.

[1]  Chris H. Q. Ding,et al.  Minimum Redundancy Feature Selection from Microarray Gene Expression Data , 2005, J. Bioinform. Comput. Biol..

[2]  A. Fukushima DiffCorr: an R package to analyze and visualize differential correlations in biological networks. , 2013, Gene.

[3]  Yi Pan,et al.  Essential Protein Discovery Based on Network Motif and Gene Ontology , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine.

[4]  A. van Oudenaarden,et al.  MicroRNA-mediated feedback and feedforward loops are recurrent network motifs in mammals. , 2007, Molecular cell.

[5]  An-Yuan Guo,et al.  MicroRNA and transcription factor co-regulatory network analysis reveals miR-19 inhibits CYLD in T-cell acute lymphoblastic leukemia , 2012, Nucleic acids research.

[6]  Sangsoo Kim,et al.  Gene expression Differential coexpression analysis using microarray data and its application to human cancer , 2005 .

[7]  A. Fuente,et al.  From ‘differential expression’ to ‘differential networking’ – identification of dysfunctional regulatory networks in diseases , 2010 .

[8]  Bertram Klinger,et al.  Computer-assisted curation of a human regulatory core network from the biological literature , 2015, Bioinform..

[9]  N. Rajewsky microRNA target predictions in animals , 2006, Nature Genetics.

[10]  Yi Pan,et al.  A New Method for Identifying Essential Proteins Based on Edge Clustering Coefficient , 2011, ISBRA.

[11]  D. Ingber,et al.  High-Betweenness Proteins in the Yeast Protein Interaction Network , 2005, Journal of biomedicine & biotechnology.

[12]  R. Fisher 019: On the Interpretation of x2 from Contingency Tables, and the Calculation of P. , 1922 .

[13]  Jeffrey A. Thompson,et al.  Common features of microRNA target prediction tools , 2014, Front. Genet..

[14]  Sourav Bandyopadhyay,et al.  Rewiring of Genetic Networks in Response to DNA Damage , 2010, Science.

[15]  J. Carulli,et al.  High throughput analysis of differential gene expression , 1998, Journal of cellular biochemistry.

[16]  A. Hatzigeorgiou,et al.  A guide through present computational approaches for the identification of mammalian microRNA targets , 2006, Nature Methods.

[17]  Jan Hauke,et al.  Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data , 2011 .

[18]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[19]  Ulf Leser,et al.  Inference of Surface Membrane Factors of HIV-1 Infection through Functional Interaction Networks , 2010, PloS one.

[20]  Liang Chen,et al.  A statistical method for identifying differential gene-gene co-expression patterns , 2004, Bioinform..

[21]  Teresa M. Przytycka,et al.  Chapter 5: Network Biology Approach to Complex Diseases , 2012, PLoS Comput. Biol..

[22]  F. Slack,et al.  Oncomirs — microRNAs with a role in cancer , 2006, Nature Reviews Cancer.

[23]  Paul Johnson Book reviews: Dowdy S, Wearden S, Chilko D 2004: Statistics for research, third edition. New York: John Wiley. 627 pp. US$99.95 (HB). ISBN 0 471 26735 X , 2007 .

[24]  Wei Niu,et al.  Construction and Analysis of an Integrated Regulatory Network Derived from High-Throughput Sequencing Data , 2011, PLoS Comput. Biol..

[25]  Anton J. Enright,et al.  Human MicroRNA Targets , 2004, PLoS biology.

[26]  Elspeth A. Bruford,et al.  Genenames.org: the HGNC resources in 2015 , 2014, Nucleic Acids Res..

[27]  Jonathan Friedman,et al.  Inferring Correlation Networks from Genomic Survey Data , 2012, PLoS Comput. Biol..

[28]  Kai Wang,et al.  Comparative analysis of microarray normalization procedures: effects on reverse engineering gene networks , 2007, ISMB/ECCB.

[29]  S. Horvath,et al.  Weighted gene coexpression network analysis strategies applied to mouse weight , 2007, Mammalian Genome.

[30]  C. Burge,et al.  Conserved Seed Pairing, Often Flanked by Adenosines, Indicates that Thousands of Human Genes are MicroRNA Targets , 2005, Cell.

[31]  Chi-Ying F. Huang,et al.  miRTarBase: a database curates experimentally validated microRNA–target interactions , 2010, Nucleic Acids Res..

[32]  Falk Schreiber,et al.  Ranking of network elements based on functional substructures. , 2007, Journal of theoretical biology.

[33]  R. Sharan,et al.  Protein networks in disease. , 2008, Genome research.

[34]  An-Yuan Guo,et al.  Transcription factor and microRNA co-regulatory loops: important regulatory motifs in biological processes and diseases , 2015, Briefings Bioinform..

[35]  Yadong Wang,et al.  miR2Disease: a manually curated database for microRNA deregulation in human disease , 2008, Nucleic Acids Res..

[36]  Yi Pan,et al.  Essential Proteins Discovery from Weighted Protein Interaction Networks , 2010, ISBRA.

[37]  Doron Lancet,et al.  MalaCards: an integrated compendium for diseases and their annotation , 2013, Database J. Biol. Databases Curation.

[38]  Di Wu,et al.  miRCancer: a microRNA-cancer association database constructed by text mining on literature , 2013, Bioinform..

[39]  T. Ideker,et al.  Differential network biology , 2012, Molecular systems biology.

[40]  Martin Reczko,et al.  DIANA-microT web server v5.0: service integration into miRNA functional analysis workflows , 2013, Nucleic Acids Res..

[41]  Obi L. Griffith,et al.  ORegAnno: an open-access community-driven resource for regulatory annotation , 2007, Nucleic Acids Res..

[42]  Chandan K. Reddy,et al.  Ranking differential genes in co-expression networks , 2011, BCB '11.

[43]  Ming Lu,et al.  TransmiR: a transcription factor–microRNA regulation database , 2009, Nucleic Acids Res..

[44]  Nicholas T. Ingolia,et al.  Mammalian microRNAs predominantly act to decrease target mRNA levels , 2010, Nature.

[45]  Steve Horvath,et al.  WGCNA: an R package for weighted correlation network analysis , 2008, BMC Bioinformatics.

[46]  E. Schadt,et al.  Characterizing the role of miRNAs within gene regulatory networks using integrative genomics techniques , 2011, Molecular systems biology.

[47]  Rainer König,et al.  Regulation patterns in signaling networks of cancer , 2010, BMC Systems Biology.

[48]  Alexander E. Kel,et al.  Transcription Regulatory Regions Database (TRRD): its status in 2000 , 2000, Nucleic Acids Res..

[49]  Aric Hagberg,et al.  Exploring Network Structure, Dynamics, and Function using NetworkX , 2008 .

[50]  David G Hendrickson,et al.  Differential analysis of gene regulation at transcript resolution with RNA-seq , 2012, Nature Biotechnology.

[51]  D. Galas,et al.  Diseases as network perturbations. , 2010, Current opinion in biotechnology.

[52]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[53]  F. Schreiber,et al.  Centrality Analysis Methods for Biological Networks and Their Application to Gene Regulatory Networks , 2008, Gene regulation and systems biology.

[54]  G. W. Hatfield,et al.  Differential analysis of DNA microarray gene expression data , 2003, Molecular microbiology.

[55]  K. Kinzler,et al.  Cancer Genome Landscapes , 2013, Science.

[56]  R. Russell,et al.  Illuminating drug discovery with biological pathways , 2005, FEBS letters.

[57]  Vladimir B. Bajic,et al.  Network analysis of microRNAs and their regulation in human ovarian cancer , 2011, BMC Systems Biology.

[58]  Alexander E. Kel,et al.  TRANSFAC® and its module TRANSCompel®: transcriptional gene regulation in eukaryotes , 2005, Nucleic Acids Res..

[59]  E. Schadt Molecular networks as sensors and drivers of common human diseases , 2009, Nature.

[60]  Michael Griffin,et al.  Gene co-expression network topology provides a framework for molecular characterization of cellular state , 2004, Bioinform..

[61]  Carsten Denkert,et al.  New network topology approaches reveal differential correlation patterns in breast cancer , 2013, BMC Systems Biology.

[62]  W. Huber,et al.  which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. MAnorm: a robust model for quantitative comparison of ChIP-Seq data sets , 2011 .

[63]  Antonio Reverter,et al.  A Differential Wiring Analysis of Expression Data Correctly Identifies the Gene Containing the Causal Mutation , 2009, PLoS Comput. Biol..

[64]  Eberhard Korsching,et al.  How MicroRNA and Transcription Factor Co-regulatory Networks Affect Osteosarcoma Cell Proliferation , 2013, PLoS Comput. Biol..

[65]  Xiaowei Wang miRDB: a microRNA target prediction and functional annotation database with a wiki interface. , 2008, RNA.

[66]  Michael Schroeder,et al.  Google Goes Cancer: Improving Outcome Prediction for Cancer Patients by Network-Based Ranking of Marker Genes , 2012, PLoS Comput. Biol..