Predicting novel microRNA: a comprehensive comparison of machine learning approaches

Motivation The importance of microRNAs (miRNAs) is widely recognized in the community nowadays because these short segments of RNA can play several roles in almost all biological processes. The computational prediction of novel miRNAs involves training a classifier for identifying sequences having the highest chance of being precursors of miRNAs (pre-miRNAs). The big issue with this task is that well-known pre-miRNAs are usually few in comparison with the hundreds of thousands of candidate sequences in a genome, which results in high class imbalance. This imbalance has a strong influence on most standard classifiers, and if not properly addressed in the model and the experiments, not only performance reported can be completely unrealistic but also the classifier will not be able to work properly for pre-miRNA prediction. Besides, another important issue is that for most of the machine learning (ML) approaches already used (supervised methods), it is necessary to have both positive and negative examples. The selection of positive examples is straightforward (well-known pre-miRNAs). However, it is difficult to build a representative set of negative examples because they should be sequences with hairpin structure that do not contain a pre-miRNA. Results This review provides a comprehensive study and comparative assessment of methods from these two ML approaches for dealing with the prediction of novel pre-miRNAs: supervised and unsupervised training. We present and analyze the ML proposals that have appeared during the past 10 years in literature. They have been compared in several prediction tasks involving two model genomes and increasing imbalance levels. This work provides a review of existing ML approaches for pre-miRNA prediction and fair comparisons of the classifiers with same features and data sets, instead of just a revision of published software tools. The results and the discussion can help the community to select the most adequate bioinformatics approach according to the prediction task at hand. The comparative results obtained suggest that from low to mid-imbalance levels between classes, supervised methods can be the best. However, at very high imbalance levels, closer to real case scenarios, models including unsupervised and deep learning can provide better performance.

[1]  Boonserm Kaewkamnerdpong,et al.  Heterogeneous ensemble approach with discriminative features and modified-SMOTEbagging for pre-miRNA classification , 2012, Nucleic acids research.

[2]  Christopher J. Cheng,et al.  MicroRNA silencing for cancer therapy targeted to the tumor microenvironment , 2014, Nature.

[3]  Tzong-Yi Lee,et al.  ViralmiR: a support-vector-machine-based method for predicting viral microRNA precursors , 2015, BMC Bioinformatics.

[4]  Spiridon D. Likothanassis,et al.  YamiPred: A Novel Evolutionary Method for Predicting Pre-miRNAs and Selecting Relevant Features , 2015, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[5]  Andrew D. Johnson,et al.  Genome-wide Identification of microRNA Expression Quantitative Trait Loci , 2015, Nature Communications.

[6]  Lee Sael,et al.  Deep Neural Network Based Precursor microRNA Prediction on Eleven Species , 2017, ArXiv.

[7]  B. Lenhard,et al.  Mammalian MicroRNA Prediction through a Support Vector Machine Model of Sequence and Structure , 2007, PloS one.

[8]  David G. Stork,et al.  Pattern Classification , 1973 .

[9]  Yusuke Yamamoto,et al.  Loss of microRNA-27b contributes to breast cancer stem cell generation by activating ENPP1 , 2015, Nature Communications.

[10]  Santosh K. Mishra,et al.  De novo SVM classification of precursor microRNAs from genomic pseudo hairpins using global and intrinsic folding measures , 2007, Bioinform..

[11]  A. T. Freitas,et al.  Current tools for the identification of miRNA genes and their targets , 2009, Nucleic acids research.

[12]  Vasile Palade,et al.  microPred: effective classification of pre-miRNAs for human miRNA gene prediction , 2009, Bioinform..

[13]  Georgina Stegmayer,et al.  miRNAfe: A comprehensive tool for feature extraction in microRNA prediction , 2015, Biosyst..

[14]  JiRongrong,et al.  Improved and promising identification of human MicroRNAs by incorporating a high-quality negative set , 2014 .

[15]  Jiuyong Li,et al.  Identifying miRNAs, targets and functions , 2012, Briefings Bioinform..

[16]  X. Chen,et al.  Random forests for genomic data analysis. , 2012, Genomics.

[17]  Georgina Stegmayer,et al.  Data Mining Over Biological Datasets: An Integrated Approach Based on Computational Intelligence , 2012, IEEE Computational Intelligence Magazine.

[18]  Jason Weston,et al.  Gene functional classification from heterogeneous data , 2001, RECOMB.

[19]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[20]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[21]  Shuigeng Zhou,et al.  MiRenSVM: towards better prediction of microRNA precursors using an ensemble SVM classifier with multi-loop features , 2010, BMC Bioinformatics.

[22]  P. Poirazi,et al.  MatureBayes: A Probabilistic Algorithm for Identifying the Mature miRNA within Novel Precursors , 2010, PloS one.

[23]  Xiaolong Wang,et al.  miRNA-dis: microRNA precursor identification based on distance structure status pairs. , 2015, Molecular bioSystems.

[24]  Douglas B. Kell,et al.  Computational cluster validation in post-genomic data analysis , 2005, Bioinform..

[25]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[26]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[27]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[28]  Ana Kozomara,et al.  miRBase: integrating microRNA annotation and deep-sequencing data , 2010, Nucleic Acids Res..

[29]  Jens Allmer,et al.  Computational methods for ab initio detection of microRNAs , 2012, Front. Gene..

[30]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[31]  Wenbin Li,et al.  PlantMiRNAPred: efficient classification of real and pseudo plant pre-miRNAs , 2011, Bioinform..

[32]  Anton J. Enright,et al.  MapMi: automated mapping of microRNA loci , 2010, BMC Bioinformatics.

[33]  Diego H. Milone,et al.  MicroRNA discovery in the human parasite Echinococcus multilocularis from genome-wide data. , 2016, Genomics.

[34]  Junjie Chen,et al.  iMiRNA-SSF: Improving the Identification of MicroRNA Precursors by Combining Negative Sets with Different Distributions , 2016, Scientific Reports.

[35]  B. Liu,et al.  Identification of Real MicroRNA Precursors with a Pseudo Structure Status Composition Approach , 2015, PloS one.

[36]  Rok Blagus,et al.  SMOTE for high-dimensional class-imbalanced data , 2013, BMC Bioinformatics.

[37]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[38]  H. Hwu,et al.  MicroRNA Expression Aberration as Potential Peripheral Blood Biomarkers for Schizophrenia , 2011, PloS one.

[39]  Ola R. Snøve,et al.  Reliable prediction of Drosha processing sites improves microRNA gene prediction. , 2007, Bioinformatics.

[40]  Peter F. Stadler,et al.  Hairpins in a Haystack: recognizing microRNA precursors in comparative genomics data , 2006, ISMB.

[41]  Georgina Stegmayer,et al.  *omeSOM: a software for clustering and visualization of transcriptional and metabolite data mined from interspecific crosses of crop plants , 2010, BMC Bioinformatics.

[42]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[43]  R. Islam,et al.  MiRANN: a reliable approach for improved classification of precursor microRNA using Artificial Neural Network model. , 2012, Genomics.

[44]  Edwin R. Hancock,et al.  Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications , 2014, Lecture Notes in Computer Science.

[45]  Li Li,et al.  Computational approaches for microRNA studies: a review , 2010, Mammalian Genome.

[46]  Lior Rokach,et al.  Data Mining And Knowledge Discovery Handbook , 2005 .

[47]  David Langenberger,et al.  Computational prediction of microRNA genes. , 2014, Methods in molecular biology.

[48]  Ashwani Jha,et al.  miR-BAG: Bagging Based Identification of MicroRNA Precursors , 2012, PloS one.

[49]  Alexander Schliep,et al.  The discriminant power of RNA features for pre-miRNA recognition , 2013, BMC Bioinformatics.

[50]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[51]  Bin Fan,et al.  MiRFinder: an improved approach and software implementation for genome-wide fast microRNA precursor scans , 2007, BMC Bioinformatics.

[52]  L. Hood,et al.  A Review of Computational Tools in microRNA Discovery , 2013, Front. Genet..

[53]  Mihaela Zavolan,et al.  Identification of Clustered Micrornas Using an Ab Initio Prediction Method , 2022 .

[54]  R. Ji,et al.  Improved and Promising Identification of Human MicroRNAs by Incorporating a High-Quality Negative Set , 2014, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[55]  Albert Kim,et al.  Detecting miRNAs in deep-sequencing data: a software performance comparison and evaluation , 2013, Briefings Bioinform..

[56]  Kyle K. Biggar,et al.  A framework for improving microRNA prediction in non-human genomes , 2015, Nucleic acids research.

[57]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[58]  Fei Li,et al.  Classification of real and pseudo microRNA precursors using local structure-sequence features and support vector machine , 2005, BMC Bioinformatics.

[59]  Peng Jiang,et al.  MiPred: classification of real and pseudo microRNA precursors using random forest prediction model with combined features , 2007, Nucleic Acids Res..

[60]  Georgina Stegmayer,et al.  High Class-Imbalance in pre-miRNA Prediction: A Novel Approach Based on deepSOM , 2017, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[61]  A. Adai,et al.  Computational prediction of miRNAs in Arabidopsis thaliana. , 2005, Genome research.

[62]  Louise C. Showe,et al.  Bioinformatics Original Paper Combining Multi-species Genomic Data for Microrna Identification Using a Naı¨ve Bayes Classifier , 2022 .

[63]  Jinyan Li,et al.  Grouping miRNAs of similar functions via weighted information content of gene ontology , 2016, BMC Bioinformatics.

[64]  Jan Baumbach,et al.  On the performance of pre-microRNA detection algorithms , 2017, Nature Communications.

[65]  Anil K. Jain.  Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[66]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[67]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[68]  Bo Wei,et al.  MiRPara: a SVM-based software tool for prediction of most probable microRNA coding regions in genome scale sequences , 2011, BMC Bioinformatics.

[69]  Marek Sikora,et al.  HuntMi: an efficient and taxon-specific approach in pre-miRNA identification , 2013, BMC Bioinformatics.

[70]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[71]  Lee Sael,et al.  DP-miRNA: An improved prediction of precursor microRNA using deep learning model , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[72]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[73]  Gustavo E. A. P. A. Batista,et al.  Class imbalance revisited: a new experimental setup to assess the performance of treatment methods , 2014, Knowledge and Information Systems.

[74]  Weixiong Zhang,et al.  MicroRNA prediction with a novel ranking algorithm based on random walks , 2008, ISMB.

[75]  Rolf Backofen,et al.  Navigating the unexplored seascape of pre-miRNA candidates in single-genome approaches , 2012, Bioinform..

[76]  Vaibhav Shukla,et al.  A compilation of Web-based research tools for miRNA analysis , 2017, Briefings in functional genomics.

[77]  D. Bartel.  MicroRNAs Genomics, Biogenesis, Mechanism, and Function , 2004, Cell.

[78]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.