Innovative Deep Learning Approach for Biomedical Data Instantiation and Visualization

One of the main problems that most of biomedical applications face, is represented by the massive amount of unlabeled data. Manually analyzing and classifying massive database by human expert is mostly unfeasible, being—in certain limited conditions (still, extremely time-consuming)—partially been done, only for simple signatures, easily recognizable by an expert. Concerning this aspect, medical experts face two challenging problems: how to select the most significant data for labeling, and what is the minimum size of the data set—but sufficient to define each pathology—to perform the training of the classifier. In this chapter, we propose a new method, based on a visual data analysis, to build an efficient classifier with a minimum of labeled data. An encoder, part of a Convolutional Variational Autoencoder (CVAE), is used as a data projection for a 2D-visualization. The input vectors are encoded into a 2D-latent space, which helps the expert to visually analyze the spatial distribution of the training data set.

[1]  Alexander Binder,et al.  Explaining nonlinear classification decisions with deep Taylor decomposition , 2015, Pattern Recognit..

[2]  Nader Fnaiech,et al.  Feedforward Neural Networks Pruning Algorithms , 2011, Intelligent Systems.

[3]  Byung-Woo Hong,et al.  Adaptive Weight Decay for Deep Neural Networks , 2019, IEEE Access.

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  Linwei Wang,et al.  Generative Modeling and Inverse Imaging of Cardiac Transmembrane Potential , 2018, MICCAI.

[6]  Ya Ju Fan,et al.  Autoencoder Node Saliency: Selecting Relevant Latent Representations , 2017, Pattern Recognit..

[7]  Ryad Zemouri,et al.  Deep Convolutional Variational Autoencoder as a 2D-Visualization Tool for Partial Discharge Source Classification in Hydrogenerators , 2020, IEEE Access.

[8]  Olvi L. Mangasarian,et al.  Nuclear feature extraction for breast tumor diagnosis , 1993, Electronic Imaging.

[9]  Leopold Parts,et al.  Computational biology: deep learning , 2017, Emerging topics in life sciences.

[10]  Xin Qi,et al.  Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images , 2018, MICCAI.

[11]  Yoshua Bengio,et al.  How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation , 2014, ArXiv.

[12]  Yoshua Bengio,et al.  Maxout Networks , 2013, ICML.

[13]  Feng Liu,et al.  Deep Learning and Its Applications in Biomedicine , 2018, Genom. Proteom. Bioinform..

[14]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[15]  Seoung Bum Kim,et al.  Process monitoring using variational autoencoder for high-dimensional nonlinear processes , 2019, Eng. Appl. Artif. Intell..

[16]  Liang Han,et al.  A Cascaded Refinement GAN for Phase Contrast Microscopy Image Super Resolution , 2018, MICCAI.

[17]  Gregory Ditzler,et al.  Learning in Nonstationary Environments: A Survey , 2015, IEEE Computational Intelligence Magazine.

[18]  Oscar Fontenla-Romero,et al.  A review of adaptive online learning for artificial neural networks , 2016, Artificial Intelligence Review.

[19]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[20]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  O. Stegle,et al.  Deep learning for computational biology , 2016, Molecular systems biology.

[22]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[23]  Zhaoyu Li,et al.  Protein Loop Modeling Using Deep Generative Adversarial Network , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[24]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[25]  Diederik P. Kingma.  Variational inference & deep learning: A new synthesis , 2017 .

[26]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[27]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[28]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[29]  Ryad Zemouri.  Semi-Supervised Adversarial Variational Autoencoder , 2020, Mach. Learn. Knowl. Extr..

[30]  Yupu Yang,et al.  Gaussian feature learning based on variational autoencoder for improving nonlinear process monitoring , 2019, Journal of Process Control.

[31]  Noureddine Zerhouni,et al.  Intelligence artificielle : quel avenir en anatomie pathologique ? , 2019, Annales de Pathologie.

[32]  Jun-Fei Qiao,et al.  A structure optimisation algorithm for feedforward neural network construction , 2013, Neurocomputing.

[33]  B. Chandra,et al.  Deep learning with adaptive learning rate using laplacian score , 2016, Expert Syst. Appl..

[34]  Noureddine Zerhouni,et al.  Deep Learning in the Biomedical Applications: Recent and Future Status , 2019, Applied Sciences.

[35]  Amir Hussain,et al.  Applications of Deep Learning and Reinforcement Learning to Biological Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[36]  N. Zerhouni,et al.  Prediction of Oncotype DX recurrence score using deep multi-layer perceptrons in estrogen receptor-positive, HER2-negative breast cancer , 2020, Breast Cancer.

[37]  David M. Blei,et al.  Variational Inference: A Review for Statisticians , 2016, ArXiv.

[38]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[39]  Linwei Wang,et al.  High-Dimensional Bayesian Optimization of Personalized Cardiac Model Parameters via an Embedded Generative Model , 2018, MICCAI.

[40]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[41]  José Carlos Príncipe,et al.  Understanding Autoencoders with Information Theoretic Concepts , 2018, Neural Networks.

[42]  Changyin Sun,et al.  Active Learning From Imbalanced Data: A Solution of Online Weighted Extreme Learning Machine , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[43]  U. Rajendra Acharya,et al.  Application of stacked convolutional and long short-term memory network for accurate identification of CAD ECG signals , 2018, Comput. Biol. Medicine.

[44]  Noureddine Zerhouni,et al.  A new growing pruning deep learning neural network algorithm (GP-DLNN) , 2019, Neural Computing and Applications.

[45]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[46]  Avid Roman-Gonzalez,et al.  Implementation of a brain-machine interface for controlling a wheelchair , 2017, 2017 CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON).

[47]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[48]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.