Performance Analysis of Deep Neural Networks for Classification of Gene-Expression Microarrays

In recent years, researchers have increased their interest in deep learning for data mining and pattern recognition applications. This is mainly due to its high processing capability and good performance in feature selection, prediction and classification tasks. In general, deep learning algorithms have demonstrated their great potential in handling large scale data sets in image recognition and natural language processing applications, which are characterized by a very large number of samples coupled with a high dimensionality. In this work, we aim at analyzing the performance of deep neural networks for classification of gene-expression microarrays, in which the number of genes is of the order of thousands while the number of samples is typically less than a hundred. The experimental results show that in some of these challenging situations, the use of deep neural networks and traditional machine learning algorithms does not always lead to high performance results. This finding suggests that deep learning needs a very large number of both samples and features to achieve high performance.

[1]  Qionghai Dai,et al.  Local visual feature fusion via maximum margin multimodal deep neural network , 2016, Neurocomputing.

[2]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[3]  Stefan Feuerriegel,et al.  Decision support from financial disclosures with deep neural networks and transfer learning , 2017, Decis. Support Syst..

[4]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[5]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[6]  Dan Wang,et al.  Modeling Physiological Data with Deep Belief Networks. , 2013, International journal of information and education technology.

[7]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[8]  Oana Geman,et al.  Deep Learning Tools for Human Microbiome Big Data , 2016, SOFA.

[9]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[10]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[11]  Reza Ghaeini,et al.  A Deep Learning Approach for Cancer Detection and Relevant Gene Identification , 2017, PSB.

[12]  Wei-Ying Ma,et al.  Bag-of-Words Based Deep Neural Network for Image Retrieval , 2014, ACM Multimedia.

[13]  Vijay V. Raghavan,et al.  Deep Learning for Natural Language Processing , 2013 .

[14]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[15]  Tetsuya Ogata,et al.  Audio-visual speech recognition using deep learning , 2014, Applied Intelligence.

[16]  Ayman M. Eldeib,et al.  Breast cancer classification using deep belief networks , 2016, Expert Syst. Appl..

[17]  Cheng Shi,et al.  Breast Cancer Malignancy Prediction Using Incremental Combination of Multiple Recurrent Neural Networks , 2017, ICONIP.

[18]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[19]  Nicholas G. Polson,et al.  Deep learning for finance: deep portfolios: J. B. HEATON, N. G. POLSON AND J. H. WITTE , 2017 .

[20]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[22]  Yaoqi Zhou,et al.  Improving protein disorder prediction by deep bidirectional long short‐term memory recurrent neural networks , 2016, Bioinform..

[23]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[24]  Robinson Thamburaj,et al.  Automated Nuclear Pleomorphism Scoring in Breast Cancer Histopathology Images Using Deep Neural Networks , 2015, MIKE.

[25]  Saeid Nahavandi,et al.  Lung cancer classification using deep learned features on low population dataset , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[26]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..